No description
Find a file
2025-02-17 12:42:45 -06:00
postgres Create Scalatra API module 2025-02-11 14:29:22 -06:00
wikigraph-api fix build issues with scalatra API module 2025-02-11 14:52:44 -06:00
wikigraph-parser add more debug printlns 2025-02-17 12:42:45 -06:00
.gitignore create the sbt project 2024-04-04 20:44:12 -05:00
compose.yaml Add database 2025-02-03 14:31:18 -06:00
download-wp-dump.sh Create Scalatra API module 2025-02-11 14:29:22 -06:00
fix_ends.sh make fix_ends executable 2025-02-08 03:53:10 +00:00
README.md first commit 2024-04-03 14:55:37 -05:00
requirements.txt make things look nicer 2024-04-04 22:57:32 -05:00

Wikigraph: Mapping Wikipedia

Wikigraph is a project intended to map how Wikipedia pages are linked together.

Architecture

graph
    subgraph PP[Wikigraph Preprocessor]
        direction LR
        WPDUMP[(Wikipedia XML Dump)]
        WPSCR[WikiScraper]
    end
    subgraph LI[Live Instance]
        direction LR
        GDB[(Graph Database)]
        API[Public API]
    end
    WP[(Wikipedia)]
    USER([End User])
    XAPPS([External Applications])
    
    WP -->|Download processed XML dumps| WPDUMP
    WPDUMP --> WPSCR
    WPSCR --> GDB
    GDB <--> API
    USER & XAPPS -->|Requests| API