Could you enable Fast RAM in the OSD, Reset the Amiga then run SysInfo, and see how many memory regions show up on the Memory page. With everything maxed out there should be four - one starting at 0x40000000, one starting at 0x00200000, one starting at 0x00c00000 and one starting at 0x00000000
I suspect that you're only going to see the latter two.
If you run the speed test you should see a speed of about 9 MIPS. If Fast RAM isn't enabled it will be significantly less.
If the Fast RAM is showing up, then could you run the two memory testers, please, and let me know whether they throw any errors?
Edit: and here's another core to test, please. (No actual changes except to phase shift and build settings, unpicking some more changes from troubleshooting jab76's issue, in the hope that it will behave on your Chameleon once again.)