- Go 100%
| Filename | Latest commit message | Latest commit date |
|---|---|---|
| magefiles | ||
| pkg | ||
| static | ||
| views | ||
| .gitignore | ||
| go.mod | ||
| go.sum | ||
| README.md | ||
| server.go | ||
icepick-web
icepick-web is a web based search tool for the DOP2 dataset inspired by the the Department of Peace icepick CLI tool.
it is built on an architecture where all data is loaded into a sqlite database, which is then loaded read only in the web app and cached in memory.
this allows for efficient searching while keeping attack surface low.
initializing the database for this application requires a version of the icepick dataset downloaded from DDoSecrets (magnet:?xt=urn:btih:5324eb5bb9a96fb03ae7768236b920561b4c6c2f)
as well a copy of the enrichment files that ship with the source code for this tool.
after unpacking the dhs folder inside the zip needs to be placed in the raw-data/ directory (so at raw-data/dhs).
locations_cleaned.json and people_enriched.json should already be placed there in the source code torrent.
Builds are run using magefile, so make sure you have mage installed. To run the application
and generate the static database (which may take upwards of 15 minutes), run mage build:runLocal,
the build binary will be placed in the build/ directory for your architecture and the database will be placed as icepicx.db in the root directory.
If you want to build a local production build for a public deployment start with something like mage build:buildLocal "https://<yourhostname.tld>" -optimize,
cross compilation can be achieved with the build:buildProd <GOOS> <GOARCH> https://<yourhostname -cc=<CC> -ccx=<CCX> target.
This application requires cgo so make sure to keep that in mind when cross compiling.
have fun!
- maia :)