gigaly.nl
robots.txt

Robots Exclusion Standard data for gigaly.nl

Resource Scan

Scan Details

Site Domain gigaly.nl
Base Domain gigaly.nl
Scan Status Ok
Last Scan2026-01-28T00:01:36+00:00
Next Scan 2026-02-27T00:01:36+00:00

Last Scan

Scanned2026-01-28T00:01:36+00:00
URL https://gigaly.nl/robots.txt
Domain IPs 104.21.76.225, 172.67.201.234, 2606:4700:3032::ac43:c9ea, 2606:4700:3033::6815:4ce1
Response IP 104.21.76.225
Found Yes
Hash 0944d503edf0b753c4105338824f75d24dc742d99c435464ce25d803398aae44
SimHash edd71f0477dc

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

adsbot-google-mobile

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

bingbot

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

seznambot

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

facebookexternalhit

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

facebot

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

pinterestbot

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

duckduckbot

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

bytespider

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /ajax
Disallow /temp

Comments

  • robots.txt for Gigaly Marketplace - MarketplacesGroup.com