ask.springshare.com
robots.txt

Robots Exclusion Standard data for ask.springshare.com

Resource Scan

Scan Details

Site Domain ask.springshare.com
Base Domain springshare.com
Scan Status Ok
Last Scan2024-09-26T00:17:26+00:00
Next Scan 2024-10-26T00:17:26+00:00

Last Scan

Scanned2024-09-26T00:17:26+00:00
URL https://ask.springshare.com/robots.txt
Domain IPs 54.83.125.71
Response IP 54.83.125.71
Found Yes
Hash 10e4a55c097a0a52c40081f28ab9fa8bcbfb0c99ad8b0da86638a5a6a257b557
SimHash 50a4cc80a303

Groups

discobot

Rule Path
Disallow /

addthis.com

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

w3c-checklink

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0

*

Rule Path
Disallow /admin
Disallow /admin/
Disallow /process_
Disallow /search/
Disallow */search/
Disallow /utility
Disallow /utility/
Disallow /load_chat.php

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://ask.springshare.com/sitemap.xml