staff.it
robots.txt

Robots Exclusion Standard data for staff.it

Resource Scan

Scan Details

Site Domain staff.it
Base Domain staff.it
Scan Status Ok
Last Scan2024-09-22T11:29:33+00:00
Next Scan 2024-10-22T11:29:33+00:00

Last Scan

Scanned2024-09-22T11:29:33+00:00
URL https://staff.it/robots.txt
Domain IPs 195.231.72.91
Response IP 195.231.72.91
Found Yes
Hash 421a21ac7fd8d68ef579dc8321b18c96865101fa07cd4d1433f09daa5baae5b2
SimHash 8bb58cb35e9b

Groups

*

Rule Path
Allow /

duckduckgo-favicons-bot

Rule Path
Disallow /

duckduckgo-favicons-bot/1.0

Rule Path
Disallow /

mail.ru_bot/robots

Rule Path
Disallow /

mail.ru_bot/robots/2.0

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefsbot/5.2

Rule Path
Disallow /

extlinksbot/1.5

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

mj12bot/v1.4.7

Rule Path
Disallow /

mj12bo

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-mobile

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

baiduspider/2.0 mobile

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexdirect

Rule Path
Disallow /

yandexdirectdyn

Rule Path
Disallow /

yandexmedia

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yadirectfetcher

Rule Path
Disallow /

yandexblogs

Rule Path
Disallow /

yandexnews

Rule Path
Disallow /

yandexpagechecker

Rule Path
Disallow /

yandexmetrika

Rule Path
Disallow /

yandexcalendar

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.realgroupsrl.it/sitemap.xml