I send the offer to my ally, he accepts, but i still cant build anything in their territory, the construction UI just says that i cannot build in foreign territory. I thought the whole point of this was to let you build airfields/infrastructure because the AI is too dumb to build those?

The AI also floods you with requests to build in your territory, its like 10+ icons on your screen, that really should be fixed.