falconai.tech
robots.txt
Robots Exclusion Standard data for falconai.tech
Resource Scan
Scan Details
Site Domain | falconai.tech |
Base Domain | falconai.tech |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-04-24T13:14:11+00:00 |
Next Scan | 2024-06-23T13:14:11+00:00 |
Last Successful Scan
Scanned | 2024-02-24T12:52:51+00:00 |
URL | https://falconai.tech/robots.txt |
Redirect | https://senpai.gg/robots.txt |
Redirect Domain | senpai.gg |
Redirect Base | senpai.gg |
Domain IPs | 52.84.251.114, 52.84.251.64, 52.84.251.88, 52.84.251.97 |
Redirect IPs | 13.33.88.101, 13.33.88.119, 13.33.88.38, 13.33.88.75 |
Response IP | 13.33.88.75 |
Found | Yes |
Hash | f7ad21aaad4a7cdc7f5aa7b4ded50c257684c1afbd9abdbcefc921fd4c12d82a |
SimHash | 680cc940c793 |
Groups
*
Rule | Path |
---|---|
Disallow | /?s=* |
Disallow | /*/feed/ |
Disallow | /*/rss2/ |
Disallow | /create-builds?champion=* |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://senpai.gg/sitemap-index.xml |