123stitch.com
robots.txt

Robots Exclusion Standard data for 123stitch.com

Resource Scan

Scan Details

Site Domain 123stitch.com
Base Domain 123stitch.com
Scan Status Ok
Last Scan2024-05-15T07:04:22+00:00
Next Scan 2024-06-14T07:04:22+00:00

Last Scan

Scanned2024-05-15T07:04:22+00:00
URL https://123stitch.com/robots.txt
Domain IPs 216.92.84.193
Response IP 216.92.84.193
Found Yes
Hash 2e669b2f2604e63f4a42ebd253a68cdc87bcddd9600d1f7247bdaefc2fd72762
SimHash 4228a192c331

Groups

bytedance

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/itemdetail.pl
Disallow /cgi-bin/redirect.pl
Disallow /cgi-perl/redirect.pl
Disallow /cgi-bin/cart/
Disallow /cgi-perl/cart/
Disallow /cgi-bin/cart/wish_list.pl
Disallow /cgi-perl/cart/wish_list.pl
Disallow /cgi-bin/BBS/bbs_register.pl
Disallow /cgi-bin/BBS/bbs_forum_read_message.cgi
Disallow /cgi-perl/BBS/bbs_register.pl
Disallow /cgi-perl/BBS/bbs_forum_read_message.cgi
Disallow /cgi-bin/abcSearch/
Disallow /cgi-perl/abcSearch/
Disallow /PriceComparison.html
Disallow /cgi-perl/privacy_policy.pl
Disallow /cgi-bin/privacy_policy.pl
Disallow /gift_catalog.html
Disallow /cgi-bin/yarn/tlc_yarn.pl
Disallow /cgi-perl/yarn/tlc_yarn.pl
Disallow /123pictures/
Disallow /Cross_Stitch_Freebie_By_Sue_Hillis.html
Disallow /cgi-bin/fb-logger.pl
Disallow /cgi-perl/fb-logger.pl

Other Records

Field Value
sitemap http://www.123stitch.com/sitemap.xml

Comments

  • Bad behavior
  • AI scrapers
  • General