reborns.com
robots.txt

Robots Exclusion Standard data for reborns.com

Resource Scan

Scan Details

Site Domain reborns.com
Base Domain reborns.com
Scan Status Ok
Last Scan2024-05-10T22:50:46+00:00
Next Scan 2024-05-17T22:50:46+00:00

Last Scan

Scanned2024-05-10T22:50:46+00:00
URL https://reborns.com/robots.txt
Redirect https://www.reborns.com/robots.txt
Redirect Domain www.reborns.com
Redirect Base reborns.com
Domain IPs 172.66.40.110, 172.66.43.146, 2606:4700:3108::ac42:286e, 2606:4700:3108::ac42:2b92
Redirect IPs 172.66.40.110, 172.66.43.146, 2606:4700:3108::ac42:286e, 2606:4700:3108::ac42:2b92
Response IP 172.66.43.146
Found Yes
Hash acf81b3482e32c5cb6e0e3987e0670c1f97ea300b74a52bc81dd498b652e30df
SimHash 8842dc70f223

Groups

*

Rule Path
Disallow /login/
Disallow /contact.cgi*
Disallow /order.cgi*
Disallow /logout.cgi*

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1