How RoleRadr reads job postings
RoleRadr helps students and job seekers in the Netherlands find vacancies on employers’ own sites. Here is exactly what it reads, and how to change that.
How it identifies itself
Every request RoleRadr makes carries this user agent:
RoleRadr/1.0 (+https://roleradr.com/bots)
It doesn’t pretend to be a browser, doesn’t use proxies or rotating addresses, and never works around a login, a paywall or bot protection.
robots.txt
Before reading a site, RoleRadr reads its robots.txt and follows the rules for RoleRadr, or for every crawler (*) when RoleRadr isn’t named. If robots.txt can’t be read for a server error, RoleRadr waits for a later check instead of going ahead. The one exception is Adzuna, whose job search RoleRadr uses with its own key under Adzuna’s API terms.
To keep RoleRadr out of your site, add:
User-agent: RoleRadr
Disallow: /
It takes effect at the next check, within about twelve hours.
What it reads, and how often
- Only public vacancy pages and the public job feeds your careers site already uses (Greenhouse, Lever, Ashby, Workday, Recruitee and similar), never pages behind a login.
- Twice a day, in the hour before 08:00 and 18:00 Amsterdam time (and when the owner starts a check by hand), with at most four requests at a time for one employer and a limit on how many postings it reads per check. A signed-in user can also check a single posting link, within a daily limit.
- Users see only roles in Amsterdam, Rotterdam, The Hague, Utrecht and Eindhoven and their surroundings.
What it shows
- A posting’s title, company, place and dates, and its text while the posting is live, always with a link to apply on your own site.
- Once a posting closes, or isn’t seen for two weeks, only its facts stay; its text is no longer shown, except to a member who saved or applied to it, in their own Tracker and to them alone. A removal request removes it there too.
- From job boards, only the start of each listing, with credit and a link back.
- For an early-career programme on your own site (an internship, a graduate programme and the like), its title, your company and the dates it was open, kept for three years to say when the next one may open; never its text.
- RoleRadr isn’t affiliated with the employers it lists and doesn’t claim to be.
Removing a posting or your site
Email privacy@roleradr.com with the posting’s link, or simply your careers site, and say what you’d like. We remove single postings for good (later checks skip them) and stop reading a site entirely on request, normally within two working days. Signed-in users can also report a posting from the job itself.