Digital Marketing

Loading...

Rendering and web scraping

  • Puppetron - Demo site that shows how to use Puppeteer and Headless Chrome to render pages. Inspired by GoogleChrome/rendertron.
  • Thal - Getting started with Puppeteer and Chrome Headless for Web Scraping.
  • pupperender - Express middleware that checks the User-Agent header of incoming requests, and if it matches one of a configurable set of bots, render the page using Puppeteer. Useful for PWA rendering.
  • headless-chrome-crawler - Crawler that provides simple APIs to manipulate Headless Chrome and allows you to crawl dynamic websites.
  • puppeteer-examples - Puppeteer Headless Chrome examples for real life use cases such as getting useful info from the web pages or common login scenarios.
  • browserless - Headless Chrome as a service letting you execute Puppeteer scripts remotely. Provides a docker image with configuration for concurrency, launch arguments and more.
  • Puppeteer Sandbox - Puppeteer sandbox environment as a service. Runs Puppeteer scripts and allows saving and embedding them in external sites and markdown files.

Comments

Post a Comment

Popular posts from this blog

MySQL Sandbox with the Sakila sample database

You can go to https://www.katacoda.com/mysql-db-sandbox/scenarios/mysql-sandbox to access the MySQL Sandbox, which has the Sakila sample database loaded in a MySQL instance. You’ll have to set up a (free) Katacoda account. Then, click the Start Scenario button. See also: https://dev.mysql.com/doc/index-other.html
Read more

How to install elgg on Openshift

rhc app create elgg php- 5.4 mysql- 5.5 cd elgg git remote add upstream -m master git://github.com/openshift-quickstart/elgg-openshift-quickstart.git git pull -s recursive -X theirs upstream master git push When the installation asks you for your data directory, use the value of the environment variable $OPENSHIFT_DATA_DIR Source: https://github.com/openshift-quickstart/elgg-openshift-quickstart Another way: After create your PHP application on Openshift, Choose: Making code changes Install the Git client for your operating system, and from your command line run git clone ssh://xxx@xxx-xxx.rhcloud.com/~/git/elgg.git/ cd elgg/ Download the  latest version of Elgg extract the file to the git folder. git add . git commit -m 'My changes' git push When you push changes the OpenShift server will report back its status on deploying your code. The server will run any of your configured  deploy hooks  and then restart the application. Create a data folder Elgg needs a spec...
Read more