Add CI task that checks if code compiles and run tests

I just noticed that pushing uncompilable code doesn't cause an error on our CI, ouch