An atomic vapor cell for performing RF measurements includes: a first optical window of transparent nonconducting material free of electrically conductive materials; an intermediate frame of transparent nonconducting material free of electrically conductive materials; a second optical window disposed on the intermediate frame and including transparent nonconducting material free of electrically conductive materials to minimize distortion of radiofrequency fields by the windows and frame; and a cell aperture, wherein the atomic vapor cell is hermetically sealed by bonding between the first optical window and the second optical window to the intermediate frame.