jrmiller82
/
pathfinder-2-sqlite-MIRROR
mirror of https://gitlab.com/jrmiller82/pathfinder-2-sqlite.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Generate readmes

merge-requests/23/head
Brian Haley 2019-08-09 01:51:55 -04:00
parent cda0ad991d
commit 37432c0435
2 changed files with 16 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

9
src/README.md 100644
View File

@ -0,0 +1,9 @@
# The purpose of this directory is to perform scraping of [Archives of Nethys](https://2e.aonprd.com)
## Requirements
1. Python 3.6.8
2. pandas==0.24.2
3. splinter==0.11.0
4. beautifulsoup4==4.8.0
5. selenium==3.141.0
6. Download the [chrome WebDriver](https://splinter.readthedocs.io/en/latest/drivers/chrome.html) and place it in this directory. It is required by selenium and splinter

7
src/weapons/README.md 100644
View File

@ -0,0 +1,7 @@
# This directory scrapes the weapons from the [Archives of Nethys](https://2e.aonprd.com/Weapons.aspx)
## Steps to scrape the weapons
1. Install the requirements from [the previous readme](../README.md)
2. Generate .csv files from copy pasting the tables from [here](https://2e.aonprd.com/Weapons.aspx) and save them in [the weapons directory](/weapons)
3. Set the number_of_weapons variable to the number of weapons in the database it is currently 83
4. Run the [python file](scrape.py) or [Jupyter Notebook](scrape.ipynb)