The Shallowest Deep Web Where Hackerranker Lives

This is a preview. View original post on this site

Search Engines like Google index pages on the Surface Web, i.e. (roughly speaking) pages that do not require a login.

Not all of those pages are indexed. Sites can tell Google not to index parts of them. The mechanism is via robots.txt files or directives on individual pages. Even though you can view those pages in incognito, you won’t find them via X-Raying.

One example is Airtable, suggested by Alla Pavlova. There are multiple contact lists of laid-off people or conference attendees, yet finds none.

Another example is Hackerrank, covered by Balazs. (In the case of Hackerrank,

Read Complete Article


Subscribe to Recruiting Headlines

* indicates required


»Need an ATS? Try JazzHR

»Cliquify: Employer Brand Platform

»Hire in 50 Countries with

»Free Rejection Email Templates

»Text Recruiting Software

»RecTech Live Webcasts

»HR Podcast Directory

»Recruiting Newsletters

»HR Tech News

»HR Jobs

»Diversity Hiring News

»Recruiter Ebooks