1800-gifts.com
robots.txt

Robots Exclusion Standard data for 1800-gifts.com

Resource Scan

Scan Details

Site Domain 1800-gifts.com
Base Domain 1800-gifts.com
Scan Status Ok
Last Scan5/23/2025, 9:55:06 PM
Next Scan 5/30/2025, 9:55:06 PM

Last Scan

Scanned5/23/2025, 9:55:06 PM
URL https://1800-gifts.com/robots.txt
Domain IPs 162.215.230.12
Response IP 162.215.230.12
Found Yes
Hash ef162443dfbf42a55e0e3b5b362fd040c92ba128aef749575de7554e372017df
SimHash 48115c40c317

Groups

*

Rule Path
Disallow /Gift
Disallow /Shop
Disallow /Default
Disallow /Delivery
Disallow /p/
Disallow /Admin/
Disallow /login
Disallow /search-result
Disallow /setcurrency
Disallow /Usercart
Disallow /Gift-Delivery

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

robozilla

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.1800-gifts.com/Multiple-Sitemap/sitemap.xml