RoleRadr Sign in

How RoleRadr reads job postings

RoleRadr helps students and job seekers in the Netherlands find vacancies on employers’ own sites. Here is exactly what it reads, and how to change that.

How it identifies itself

Every request RoleRadr makes carries this user agent:

RoleRadr/1.0 (+https://roleradr.com/bots)

It doesn’t pretend to be a browser, doesn’t use proxies or rotating addresses, and never works around a login, a paywall or bot protection.

robots.txt

Before reading a site, RoleRadr reads its robots.txt and follows the rules for RoleRadr, or for every crawler (*) when RoleRadr isn’t named. If robots.txt can’t be read for a server error, RoleRadr waits for a later check instead of going ahead. The one exception is Adzuna, whose job search RoleRadr uses with its own key under Adzuna’s API terms.

To keep RoleRadr out of your site, add:

User-agent: RoleRadr
Disallow: /

It takes effect at the next check, within about twelve hours.

What it reads, and how often

What it shows

Removing a posting or your site

Email privacy@roleradr.com with the posting’s link, or simply your careers site, and say what you’d like. We remove single postings for good (later checks skip them) and stop reading a site entirely on request, normally within two working days. Signed-in users can also report a posting from the job itself.