Log In Sign Up

gibud.no
robots.txt

Robots Exclusion Standard data for gibud.no

Resource Scan

Scan Details

Site Domain gibud.no
Base Domain gibud.no
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-10T04:33:08+00:00
Next Scan 2025-11-08T04:33:08+00:00

Last Successful Scan

Scanned2023-12-27T03:36:42+00:00
URL https://gibud.no/robots.txt
Domain IPs 172.66.40.215, 172.66.43.41, 2606:4700:3108::ac42:28d7, 2606:4700:3108::ac42:2b29
Response IP 172.66.40.215
Found Yes
Hash f5f78c33524c0b14dae3903f5899949e2e0f51e51b8ad4d9162e09d9553e6c47
SimHash 5cb4d80007d2

Groups

bingbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /Membership/
Disallow /Auction/APSearch.asp

amazonbot

Product Comment
amazonbot Amazon's user agent
Rule Path Comment
Disallow /Membership/ disallow this directory
Disallow /Auction/APSearch.asp -

*

Product Comment
* any robot
Rule Path Comment
Disallow /Membership/ disallow this directory
Disallow /Auction/APSearch.asp -
Back to top

Other Records

Field Value
sitemap https://gibud.no/Membership/XUDSitemap.asp
Back to top