Load testing for SMW
From semantic-mediawiki.org
The goal of the load testing is to get precise numbers of whatour software is capable to do and how performance is affected by the data. We need these numbers to measure the effect of optimizations and to recommend our tool to use for load-demannding purposes.
Contents
What have been done so far[edit]
- Measurements by KIT: http://iswc2010.semanticweb.org/pdf/397.pdf
- Probably something have been done by Markus Krötzsch and Nischay during Green SMW Project: http://greensmw.wordpress.com/
- Probably large SMW installations have some infomation about the current limitations: NYCPedia, Wikia, BlueBrain Project.
Mentors from MW and SMW community[edit]
add yourself here!
What to test[edit]
Here is the unstructed list of stuff that seems important to test/
Low level[edit]
- dependency between the amount of property values and the time to read the property value
- dependency between the amount of property values and the time to write the property value
- same with subobjects
- same with different stores: 4Store, SQLStore, Virtuoso.
- factors that increase memory consumption
- client-side testing: how fast and small is our javascript?
- variations for different server configurations
- PLEASE WRITE MORE
High level[edit]
- responce time for the page with not cached queries
- PLEASE WRITE MORE
Requirements for tests[edit]
- tests have to be reproducable
- tests have to be reusable
