Log In Sign Up

amt-law.com
robots.txt

Robots Exclusion Standard data for amt-law.com

Resource Scan

Scan Details

Site Domain amt-law.com
Base Domain amt-law.com
Scan Status Ok
Last Scan2024-06-07T16:37:15+00:00
Next Scan 2024-07-07T16:37:15+00:00

Last Scan

Scanned2024-06-07T16:37:15+00:00
URL https://amt-law.com/robots.txt
Redirect https://www.amt-law.com/robots.txt
Redirect Domain www.amt-law.com
Redirect Base amt-law.com
Domain IPs 3.165.82.125, 3.165.82.15, 3.165.82.22, 3.165.82.43
Redirect IPs 13.35.18.108, 13.35.18.20, 13.35.18.44, 13.35.18.54, 2600:9000:20c7:200:d:a1f5:88c0:93a1, 2600:9000:20c7:3e00:d:a1f5:88c0:93a1, 2600:9000:20c7:4000:d:a1f5:88c0:93a1, 2600:9000:20c7:6200:d:a1f5:88c0:93a1, 2600:9000:20c7:8e00:d:a1f5:88c0:93a1, 2600:9000:20c7:aa00:d:a1f5:88c0:93a1, 2600:9000:20c7:e800:d:a1f5:88c0:93a1, 2600:9000:20c7:fc00:d:a1f5:88c0:93a1
Response IP 13.35.18.44
Found Yes
Hash 616573769e37846997f533b0fc86b18412e597c84fdfd1246f0f3d9c24d1b572
SimHash 6344d4876f8a

Groups

*

Rule Path
Disallow /private/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

sogou blog

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

sogou inst spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

sogou news spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

sogou orion spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

sogou spider2

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

sogou web spider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30
Back to top