With credit cards of banks outside of Japan you can not take money at all ATM in Japan. But Japanese Post Offices and the Seven Eleven Convenience shops have ATM, where your foreign credit cards work. Both offer locators for their shops:
Locator for Japanese Post Offices with ATM (Just zoom the map)
Locator for Seven Eleven Shops with ATM in Japan
