Abstract: A comparison method and evaluation system to compare the accuracy and performance of programming ontology reasoners (supporting DIG and Jena interface) are presented. Experimental results show that ontology reasoners are varied widely at accuracy, and therefore a critical assessment and evaluation of requirements are needed before selecting a reasoner for real-life applications.