internetbuyer.com
robots.txt
Robots Exclusion Standard data for internetbuyer.com
Resource Scan
Scan Details
Site Domain | internetbuyer.com |
Base Domain | internetbuyer.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-08-31T15:54:19+00:00 |
Next Scan | 2024-11-29T15:54:19+00:00 |
Last Successful Scan
Scanned | 2023-08-08T14:10:33+00:00 |
URL | https://www.internetbuyer.com/robots.txt |
Domain IPs | 2600:9000:21e1:2400:1d:cc7e:e840:93a1, 2600:9000:21e1:5800:1d:cc7e:e840:93a1, 2600:9000:21e1:6400:1d:cc7e:e840:93a1, 2600:9000:21e1:be00:1d:cc7e:e840:93a1, 2600:9000:21e1:c000:1d:cc7e:e840:93a1, 2600:9000:21e1:c00:1d:cc7e:e840:93a1, 2600:9000:21e1:ca00:1d:cc7e:e840:93a1, 2600:9000:21e1:f400:1d:cc7e:e840:93a1, 99.84.133.101, 99.84.133.118, 99.84.133.4, 99.84.133.71 |
Response IP | 18.66.122.38 |
Found | Yes |
Hash | c36038f68d31ed8131910e30c74bf61cafed0157138de412d1697facdbca96dd |
SimHash | 2400d0c05592 |
Groups
*
Rule | Path |
---|---|
Disallow | /api |
Disallow | /click_ad |
Disallow | /clk_ad |
Disallow | /wr_clk |
Comments