sluurpy.at
robots.txt

Robots Exclusion Standard data for sluurpy.at

Resource Scan

Scan Details

Site Domain sluurpy.at
Base Domain sluurpy.at
Scan Status Ok
Last Scan2024-10-30T15:37:15+00:00
Next Scan 2024-11-06T15:37:15+00:00

Last Scan

Scanned2024-10-30T15:37:15+00:00
URL https://sluurpy.at/robots.txt
Redirect https://www.sluurpy.at/robots.txt
Redirect Domain www.sluurpy.at
Redirect Base sluurpy.at
Domain IPs 46.4.208.75
Redirect IPs 46.4.208.75
Response IP 46.4.208.75
Found Yes
Hash 472e362562e99ac4b88c49e52b4b7f2bdf3716b3a816c02412f59159c596fb1e
SimHash ed188696d252

Groups

googlebot

Rule Path
Disallow /api/
Disallow /ajax
Allow /ajax/restaurants
Allow /ajax/restaurant
Disallow /sluurpy-awards

googlebot-mobile

Rule Path
Disallow /api/
Disallow /ajax
Allow /ajax/restaurants
Allow /ajax/restaurant
Disallow /sluurpy-awards

googlebot-image

Rule Path
Disallow /api/
Disallow /ajax
Allow /ajax/restaurants
Allow /ajax/restaurant
Disallow /sluurpy-awards

mediapartners-google

Rule Path
Disallow /api/
Disallow /ajax
Allow /ajax/restaurants
Allow /ajax/restaurant
Disallow /sluurpy-awards

*

Rule Path
Disallow /api/
Disallow /ajax
Allow /ajax/restaurants
Allow /ajax/restaurant
Disallow /sluurpy-awards

Other Records

Field Value
crawl-delay 5

sentibot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

bytespider

Rule Path
Disallow /