gigaly.it
robots.txt

Robots Exclusion Standard data for gigaly.it

Resource Scan

Scan Details

Site Domain gigaly.it
Base Domain gigaly.it
Scan Status Ok
Last Scan2025-12-17T11:12:28+00:00
Next Scan 2025-12-31T11:12:28+00:00

Last Scan

Scanned2025-12-17T11:12:28+00:00
URL https://gigaly.it/robots.txt
Domain IPs 104.21.29.20, 172.67.171.66, 2606:4700:3030::ac43:ab42, 2606:4700:3033::6815:1d14
Response IP 104.21.29.20
Found Yes
Hash 0944d503edf0b753c4105338824f75d24dc742d99c435464ce25d803398aae44
SimHash edd71f0477dc

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

adsbot-google-mobile

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

bingbot

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

seznambot

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

facebookexternalhit

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

facebot

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

pinterestbot

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

duckduckbot

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

bytespider

Rule Path
Disallow /ajax
Disallow /temp

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /ajax
Disallow /temp

Comments

  • robots.txt for Gigaly Marketplace - MarketplacesGroup.com