Optimizing Ward's Queries

Ward scrapes on a private server and then builds on a digital ocean server that also supports the experimental plugins.

See Ruby Sitemap Scrape for our scrape experiments.

See Neo4J for our history with the product.

# Queries

We construct batch input files for nodes and relations from files we construct in the scrape process. github

We launch a batch build on the server that hosts our cypher plugin. github log

The cypher plugin server-side passes parameters from wiki to the neo4j database. github

The cypher plugin client-side parses sites and slugs which will be passed to the server-side. github