pizzabulls.simplywebshop.de
robots.txt

Robots Exclusion Standard data for pizzabulls.simplywebshop.de

Resource Scan

Scan Details

Site Domain pizzabulls.simplywebshop.de
Base Domain simplywebshop.de
Scan Status Ok
Last Scan2024-09-23T17:10:54+00:00
Next Scan 2024-10-23T17:10:54+00:00

Last Scan

Scanned2024-09-23T17:10:54+00:00
URL https://pizzabulls.simplywebshop.de/robots.txt
Domain IPs 2600:9000:2024:1a00:13:ff2a:a500:93a1, 2600:9000:2024:4400:13:ff2a:a500:93a1, 2600:9000:2024:4800:13:ff2a:a500:93a1, 2600:9000:2024:6800:13:ff2a:a500:93a1, 2600:9000:2024:a800:13:ff2a:a500:93a1, 2600:9000:2024:c00:13:ff2a:a500:93a1, 2600:9000:2024:ca00:13:ff2a:a500:93a1, 2600:9000:2024:ee00:13:ff2a:a500:93a1, 54.230.112.11, 54.230.112.116, 54.230.112.118, 54.230.112.23
Response IP 52.85.49.54
Found Yes
Hash 5154e2311aa20ba51af105852024d9ff2d01a719786be403ffabf5fdbbba561c
SimHash 281a4086e672

Groups

webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea

Rule Path
Disallow /

*

Rule Path
Disallow /dataPrivacy
Disallow /imprint
Disallow /apilogindenied
Disallow /autologout
Disallow /commonerror
Disallow /devdata
Disallow /permissiondenied
Disallow /nojs
Disallow /newerBrowser
Disallow /setIFrameSession
Disallow /health
Disallow /systemdata
Disallow /saveCookieChoise
Disallow /simulateWebsiteWithIframe

Other Records

Field Value
sitemap https://pizzabulls.simplywebshop.de/sitemap