aitrillion.com
robots.txt

Robots Exclusion Standard data for aitrillion.com

Resource Scan

Scan Details

Site Domain aitrillion.com
Base Domain aitrillion.com
Scan Status Ok
Last Scan2024-06-01T02:13:20+00:00
Next Scan 2024-07-01T02:13:20+00:00

Last Scan

Scanned2024-06-01T02:13:20+00:00
URL https://aitrillion.com/robots.txt
Redirect https://www.aitrillion.com/robots.txt
Redirect Domain www.aitrillion.com
Redirect Base aitrillion.com
Domain IPs 18.210.136.128
Redirect IPs 18.155.68.24, 18.155.68.30, 18.155.68.47, 18.155.68.55, 2600:9000:23d2:4000:1b:4b5b:a2c0:93a1, 2600:9000:23d2:4e00:1b:4b5b:a2c0:93a1, 2600:9000:23d2:7400:1b:4b5b:a2c0:93a1, 2600:9000:23d2:8600:1b:4b5b:a2c0:93a1, 2600:9000:23d2:9e00:1b:4b5b:a2c0:93a1, 2600:9000:23d2:b200:1b:4b5b:a2c0:93a1, 2600:9000:23d2:de00:1b:4b5b:a2c0:93a1, 2600:9000:23d2:ec00:1b:4b5b:a2c0:93a1
Response IP 18.155.68.47
Found Yes
Hash b9bfad283b9ba8a016e2f1cef12fafef6d48cd8e64f5ae4ca476f67d7df58974
SimHash 6f01d850c132

Groups

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /whats-new-2
Disallow /whats-new-old
Disallow /wp-admin/
Disallow /aitrillion-app
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.aitrillion.com/sitemap_index.xml