You want to run your tests when you commit on github project. Here is how you can do it. This is called Continuous Integration for your open Source project.