ScrapyPy is a free, open-source, and powerful web scraping tool that simplifies the web scraping process |—-|
To use ScrapyPy, ensure you have Python installed on your system. If not, download the latest version from the official Python website: https://python.org/downloads
Before using ScrapyPy, install the required dependencies by running the following command in your terminal:
$ pip install -r requirements.txt
Once the dependencies are installed, run the following command in your terminal:
$ python main.py
The following is a basic example of the output you should see after running the previous command:
Enter the URL for scraping: https://www.google.com
Do you want to save the scraped response in a seperate file? (Y/N): Y
What should be the name of the file: google-scrapping.txt
ScrapyPy is released under the GPL-3.0 license.
View the full license terms here.
Found a bug or want a new feature?
Report issues and request features on the ScrapyPy issue tracker.
Thanks for reading!
Have a great day ahead :D