productionhub.com
robots.txt

Robots Exclusion Standard data for productionhub.com

Resource Scan

Scan Details

Site Domain productionhub.com
Base Domain productionhub.com
Scan Status Ok
Last Scan2024-06-14T23:51:12+00:00
Next Scan 2024-07-14T23:51:12+00:00

Last Scan

Scanned2024-06-14T23:51:12+00:00
URL https://productionhub.com/robots.txt
Redirect https://www.productionhub.com/robots.txt
Redirect Domain www.productionhub.com
Redirect Base productionhub.com
Domain IPs 104.22.64.195, 104.22.65.195, 172.67.7.131, 2606:4700:10::6816:40c3, 2606:4700:10::6816:41c3, 2606:4700:10::ac43:783
Redirect IPs 104.22.64.195, 104.22.65.195, 172.67.7.131, 2606:4700:10::6816:40c3, 2606:4700:10::6816:41c3, 2606:4700:10::ac43:783
Response IP 104.22.64.195
Found Yes
Hash 67c858e89d374b8249417fc9604a68d0d2f5978b9385801fc0bdbfb91f5fc1c7
SimHash f21dfcd0e610

Groups

*

Rule Path
Disallow /pl/*
Disallow /ads/*
Disallow /api/*
Disallow /redirect/*
Disallow /blog/search*
Disallow /casting-notices/search*
Disallow /classifieds/search*
Disallow /directory/search*
Disallow /events/search*
Disallow /gear/search*
Disallow /jobs/search*
Disallow /press-releases/search*
Disallow /videos/search*

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot-media

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

accompanybot
ahrefsbot
discoverybot
charlotte
baiduspider
mj12bot
speedy
exabot
linguee
semrushbot
yandex
trendictionbot
bot*
bot\*
buck
blexbot
istellabot
legs
nbot
linkpadbot
dotbot
megaindex.ru
megaindex.ru/2.0
megaindex.ru
petalbot
nbot
amazonbot
obot
blexbot
gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.productionhub.com/sitemap-index.xml

Warnings

  • 1 invalid line.