acgl.co.za
robots.txt
Robots Exclusion Standard data for acgl.co.za
Resource Scan
Scan Details
| Site Domain | acgl.co.za |
| Base Domain | acgl.co.za |
| Scan Status | Ok |
| Last Scan | 2024-11-11T18:15:22+00:00 |
| Next Scan | 2024-11-18T18:15:22+00:00 |
Last Scan
| Scanned | 2024-11-11T18:15:22+00:00 |
| URL | https://acgl.co.za/robots.txt |
| Redirect | https://acgl.gg/robots.txt |
| Redirect Domain | acgl.gg |
| Redirect Base | acgl.gg |
| Domain IPs | 160.119.101.76 |
| Redirect IPs | 172.66.40.188, 172.66.43.68, 2606:4700:3108::ac42:28bc, 2606:4700:3108::ac42:2b44 |
| Response IP | 172.66.43.68 |
| Found | Yes |
| Hash | ceb01c44724a24765b5a862f95cea2876f4f63973592851551e622fd8501210c |
| SimHash | 3c945d09e6f8 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /misc/*.css$ |
| Allow | /misc/*.css? |
| Allow | /misc/*.js$ |
| Allow | /misc/*.js? |
| Allow | /misc/*.gif |
| Allow | /misc/*.jpg |
| Allow | /misc/*.jpeg |
| Allow | /misc/*.png |
| Allow | /modules/*.css$ |
| Allow | /modules/*.css? |
| Allow | /modules/*.js$ |
| Allow | /modules/*.js? |
| Allow | /modules/*.gif |
| Allow | /modules/*.jpg |
| Allow | /modules/*.jpeg |
| Allow | /modules/*.png |
| Allow | /profiles/*.css$ |
| Allow | /profiles/*.css? |
| Allow | /profiles/*.js$ |
| Allow | /profiles/*.js? |
| Allow | /profiles/*.gif |
| Allow | /profiles/*.jpg |
| Allow | /profiles/*.jpeg |
| Allow | /profiles/*.png |
| Allow | /themes/*.css$ |
| Allow | /themes/*.css? |
| Allow | /themes/*.js$ |
| Allow | /themes/*.js? |
| Allow | /themes/*.gif |
| Allow | /themes/*.jpg |
| Allow | /themes/*.jpeg |
| Allow | /sites/all/*.css$ |
| Allow | /sites/all/*.css? |
| Allow | /sites/all/*.js$ |
| Allow | /sites/all/*.js? |
| Allow | /sites/all/*.gif |
| Allow | /sites/all/*.jpg |
| Allow | /sites/all/*.jpeg |
| Allow | /sites/all/*.png |
| Allow | /files/*.css$ |
| Allow | /files/*.css? |
| Allow | /files/*.js$ |
| Allow | /files/*.js? |
| Allow | /files/*.gif |
| Allow | /files/*.jpg |
| Allow | /files/*.jpeg |
| Allow | /files/*.png |
| Disallow | /includes/ |
| Disallow | /misc/ |
| Disallow | /modules/ |
| Disallow | /profiles/ |
| Disallow | /scripts/ |
| Disallow | /themes/ |
| Disallow | /CHANGELOG.txt |
| Disallow | /cron.php |
| Disallow | /INSTALL.mysql.txt |
| Disallow | /INSTALL.pgsql.txt |
| Disallow | /INSTALL.sqlite.txt |
| Disallow | /install.php |
| Disallow | /INSTALL.txt |
| Disallow | /LICENSE.txt |
| Disallow | /MAINTAINERS.txt |
| Disallow | /update.php |
| Disallow | /UPGRADE.txt |
| Disallow | /xmlrpc.php |
| Disallow | /admin/ |
| Disallow | /comment/reply/ |
| Disallow | /filter/tips/ |
| Disallow | /node/add/ |
| Disallow | /search/ |
| Disallow | /node/ |
| Disallow | /taxonomy/ |
| Disallow | /team/ |
| Disallow | /user/ |
| Disallow | /u/ |
| Disallow | /clip/ |
| Disallow | /playlist/ |
| Disallow | /challenge/ |
| Disallow | /mission/ |
| Disallow | /ruleset/ |
| Disallow | /guide/ |
| Disallow | /matchfinders/matches |
| Disallow | /loot/ |
| Disallow | /mail/ |
| Disallow | /t/ |
| Disallow | /*/t/ |
| Disallow | /match/ |
| Disallow | /*/match/ |
| Disallow | /wp-login.php |
| Disallow | %5E.*%5C/wp-includes%5C/wlwmanifest.xml |
| Disallow | /wp-json/ |
| Disallow | /wp-admin/ |
| Disallow | /chatserver/ |
| Disallow | /acglendpoint/ |
| Disallow | /.well-known/ |
| Disallow | /rss/ |
| Disallow | /feeds/ |
| Disallow | /feed/ |
| Disallow | /apple-touch-icon.png |
| Disallow | /apple-touch-icon-precomposed.png |
| Disallow | /*? |
| Disallow | /*?page=*&* |
| Disallow | /*?page=0* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments