Log In Sign Up

deeds.com
robots.txt

Robots Exclusion Standard data for deeds.com

Resource Scan

Scan Details

Site Domain deeds.com
Base Domain deeds.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-12T18:31:16+00:00
Next Scan 2026-01-11T18:31:16+00:00

Last Successful Scan

Scanned2025-08-21T19:50:59+00:00
URL https://deeds.com/robots.txt
Redirect https://www.deeds.com/robots.txt
Redirect Domain www.deeds.com
Redirect Base deeds.com
Domain IPs 2606:d280:8:2::2, 64.40.13.22
Redirect IPs 2606:d280:8:2::2, 64.40.13.22
Response IP 64.40.13.22
Found Yes
Hash 671ae07789dd6598fea6099df88bde034a1e871ec20863507eabe23a44e27a09
SimHash e6175214c703

Groups

*

Rule Path
Disallow /fdl/
Disallow /api/
Disallow /admin/
Disallow /private/

baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
sogou spider
sogou web spider

Rule Path
Disallow /

yandexbot
yandeximages
yandexmetrika
mail.ru_bot

Rule Path
Disallow /

yeti
naverbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /
Back to top

Comments

  • Chinese search engines - blocking due to aggressive crawling and low-quality traffic
  • Russian search engines - blocking due to regional targeting
  • Korean search engines
  • Other international search engines
Back to top