There is no redstone, signs or mobs which could cause lag. It is only this place where lags and it happens to others as well. It could be nice temple but I can't finish it with these fps. Coords are: X8200 Y9000 in Pandora.
EDIT: After hours of searching I found the problem. My render distance was too low. Because my temple was big MC wasn't able to render whole building and that is sometimes reason for huge TFP lag. I set my render to 15 so now it works properly. So if you get FPS lags near some big buildings make sure you have render distance big enough.