Can I cancel my contract to buy?

You are buying the home from the builder, correct? So, your contract is with the builder, not the real estate agent. So, you need to talk with the builder, or the builder's representative.