astrolove.com
robots.txt
Robots Exclusion Standard data for astrolove.com
Resource Scan
Scan Details
| Site Domain | astrolove.com |
| Base Domain | astrolove.com |
| Scan Status | Ok |
| Last Scan | 2024-11-04T13:11:54+00:00 |
| Next Scan | 2024-11-11T13:11:54+00:00 |
Last Scan
| Scanned | 2024-11-04T13:11:54+00:00 |
| URL | https://astrolove.com/robots.txt |
| Redirect | https://www.astrolove.com/robots.txt |
| Redirect Domain | www.astrolove.com |
| Redirect Base | astrolove.com |
| Domain IPs | 104.83.196.218, 2600:1413:b000:681::498, 2600:1413:b000:68d::498 |
| Redirect IPs | 104.17.160.60, 104.17.161.60, 2606:4700::6811:a03c, 2606:4700::6811:a13c |
| Response IP | 104.17.160.60 |
| Found | Yes |
| Hash | d642ac7e19360c1cf998879828f9424b418f4fd8d5ae47db91484be6efe74e12 |
| SimHash | e8c44d14d9d5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /chat/ |
| Disallow | /?gender |
| Disallow | /404/ |
| Disallow | /texts |
| Disallow | /*/about/ |
| Disallow | /*/faqs/ |
| Disallow | /faq/ |
| Disallow | /*minage%3D |
| Disallow | /*maxage |
| Disallow | /*?afid= |
| Disallow | /*?gclid= |
| Disallow | /*utm_campaign%3D |
| Disallow | /*utm_content%3D |
| Disallow | /*utm_channel%3D |
| Disallow | /*?dc= |
| Disallow | /*?pp= |
| Disallow | /admin/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.astrolove.com/sitemap.xml |