catalystapps.net
robots.txt
Robots Exclusion Standard data for catalystapps.net
Resource Scan
Scan Details
| Site Domain | catalystapps.net |
| Base Domain | catalystapps.net |
| Scan Status | Ok |
| Last Scan | 2024-06-21T08:50:54+00:00 |
| Next Scan | 2024-06-28T08:50:54+00:00 |
Last Scan
| Scanned | 2024-06-21T08:50:54+00:00 |
| URL | https://catalystapps.net/robots.txt |
| Redirect | https://www.catalystapps.net/robots.txt |
| Redirect Domain | www.catalystapps.net |
| Redirect Base | catalystapps.net |
| Domain IPs | 167.172.122.98 |
| Redirect IPs | 167.172.122.98 |
| Response IP | 167.172.122.98 |
| Found | Yes |
| Hash | 92639ffca827d3c836b77ada3e9ce546724e38bb5c875e2efec910cfbdd0954d |
| SimHash | a5b8dca09f99 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /images/ |
| Disallow | /img/ |
| Disallow | /js |
| Disallow | /css |
| Disallow | /fonts |
| Disallow | /404.php |
| Disallow | /members/ |
| Disallow | /site_docs/ |
| Disallow | /shopping/ |
| Disallow | /gallery/view |
| Disallow | /gallery.fcgi |
| Disallow | /gallery/ |
| Disallow | /webpages/addphotos.shtml |
| Disallow | /webpages/saveflick.shtml |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |