When Supergirl was fighting Rama Kahn in the Fortress of Solitude, she showed that he could only control Earth and not Krypton soil/environment. He should not have been able to pull the Kryptonite from the walls and Earth around him as it is also from Krypton. They stated that the staff gave him more power, but never that it would alter his abilities.