roadloans.com
robots.txt

Robots Exclusion Standard data for roadloans.com

Resource Scan

Scan Details

Site Domain roadloans.com
Base Domain roadloans.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-14T06:43:17+00:00
Next Scan 2025-01-12T06:43:17+00:00

Last Successful Scan

Scanned2023-11-27T06:27:50+00:00
URL https://roadloans.com/robots.txt
Domain IPs 192.0.66.2
Response IP 192.0.66.2
Found Yes
Hash 3b5e4252721397db920fcefd12caf1fc8655a73bed16d3477b1947ee9fbd8fed
SimHash 4754ce50ea93

Groups

*

Rule Path
Disallow /next/
Disallow /mshots/v1/
Disallow /activate/
Disallow /public.api/
Disallow /cgi-bin/
Disallow /wp-login.php
Disallow /?attachment_id=*
Disallow /wp-admin/
Disallow /blog/*?share=*
Disallow /?s
Disallow /?s=
Disallow /?s&amp%3B*
Disallow /?s=&amp%3B*
Disallow /?*&amp%3Bs
Disallow /?*&amp%3Bs=
Disallow /?*&amp%3Bs&amp%3B*
Disallow /?*&amp%3Bs=&amp%3B*

irlbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3600

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://roadloans.com/sitemap.xml
sitemap https://roadloans.com/sitemap.xml
sitemap https://roadloans.com/news-sitemap.xml