SMWCon Fall 2012/Improvements in SQLStore3/Presentation

Loading...

• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/1.1
  

  GreenSMW

  YES

  
  bit.ly/greensmw

  
• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/1.2
  

  GreenSMW

  YES

  GSoC:Proposal

  Improve the performance for the relational backend of SMW by identifying major bottlenecks.

• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/1.3
  

  GreenSMW

  YES

  
  

  In SQLStore2

  • More dataItems, less table structures.

  
  

  • Numbers, Strings, Boolean, URI, Time all in one table

  
  

  • Difficult to add new datatypes. Eg. Coordinates

  
  

  • DB access needs complex computation, error prone code and compatibility handlers.
• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/1.4
  

  GreenSMW

  YES

  
  

  In SQLStore3

  • More table structures

  
  

  • Easy to add new datatypes with DIHandlers(atleast for me!)

  
  

  • Dedicated tables for highly used properties
• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/1.5
  

  GreenSMW

  YES

  
  

  In SQLStore2

  • Too many SQL reads in one run

  
  

  • Too many SQL deletes and inserts

  
  

   	“ But I didn’t change any Property-Value! “
  
  

• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/1.6
  

  GreenSMW

  YES

  
  

  In SQLStore3

  • Have in-memory cache for stuff

  
  

  • Write selectively over many tables

  
  

  Delete all data → Write all data

  
  

  Delete/Write only what has changed

  
  

• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/1.7
  

  GreenSMW

  YES

  
  

  Special pages

  SLOW!!

  
  

  CPU Intensive!!

• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/1.8
  

  GreenSMW

  YES

  
  

  In SQLStore3

  • Uses pre-computed statistics

  
  

  • Special:Properties does just a lookup
• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/1.9
  

  GreenSMW

  YES

  Yet to be done…

  

  
  

  • Better indexing of tables

  
  

  • Diff feature
  • Have you used SemanticWatchlist?

  
  

  • No SQLStore2
• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/2.1
  

  GreenSMW

  YES

  Diffing

  
• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/2.2
  

  GreenSMW

  YES

  Okay! I need Store3

  • Upgrade using refresh scripts

  
  

  • Upgrade using Migration script
• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/2.3
  

  GreenSMW

  YES

  Using refresh scripts

  • Run the setup at Special:SMWAdmin
  • Start the SMW_refreshData script (leave it for a while)
• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/2.4
  

  GreenSMW

  YES

  Using migration scripts

  • Run the SMW_migration script
  • Run the SMW_resetStats script
• SMWCon Fall 2012/Improvements in SQLStore3/Presentation/2.5
  

  GreenSMW

  YES

  Acknowledgements