Iran has been restricting U.N. nuclear inspectors' access to its main uranium enrichment plant at Natanz, citing security concerns after what it says was an attack on the site by Israel in April, diplomats say.