orafaq.com
robots.txt

Robots Exclusion Standard data for orafaq.com

Resource Scan

Scan Details

Site Domain orafaq.com
Base Domain orafaq.com
Scan Status Ok
Last Scan2025-10-24T14:40:12+00:00
Next Scan 2025-10-31T14:40:12+00:00

Last Scan

Scanned2025-10-24T14:40:12+00:00
URL https://orafaq.com/robots.txt
Redirect https://www.orafaq.com/robots.txt
Redirect Domain www.orafaq.com
Redirect Base orafaq.com
Domain IPs 188.138.29.199
Redirect IPs 188.138.29.199
Response IP 188.138.29.199
Found Yes
Hash 092faf2bb491190a89e5ac28bfceebcf0366b69b02e928e906ffa9daecfcf7c8
SimHash c82c4daaaae8

Groups

*

Rule Path
Disallow /*?*
Disallow /admin
Disallow /img
Disallow /cgi-bin
Disallow /test
Disallow /maillist/oracle-l/current
Disallow /usenet/comp.databases.theory/current
Disallow /usenet/comp.databases.mysql/current
Disallow /usenet/comp.databases.oracle.server/current
Disallow /usenet/comp.databases.oracle.tools/current
Disallow /usenet/comp.databases.oracle.misc/current
Disallow /usenet/comp.databases.oracle/current
Disallow /usenet/comp.databases.oracle.marketplace
Disallow /forum/a/
Disallow /forum/adm/
Disallow /forum/bl/
Disallow /forum/d/
Disallow /forum/ef/
Disallow /forum/gm/
Disallow /forum/h/
Disallow /forum/i/
Disallow /forum/il/
Disallow /forum/ip/
Disallow /forum/l/
Disallow /forum/lk/
Disallow /forum/m/
Disallow /forum/ma/
Disallow /forum/mar/
Disallow /forum/ml/
Disallow /forum/mn/
Disallow /forum/mv/
Disallow /forum/ot/
Disallow /forum/pdm/
Disallow /forum/pl/
Disallow /forum/pmm/
Disallow /forum/r/
Disallow /forum/re/
Disallow /forum/rm/
Disallow /forum/s/
Disallow /forum/sp/
Disallow /forum/sel/
Disallow /forum/st/
Disallow /forum/tt/
Disallow /forum/u/
Disallow /forum/uc/
Disallow /wiki/index.php
Disallow /wiki/Special%3ARandom
Disallow /wiki/Special%3ARandom
Disallow /wiki/Special%3ASearch
Disallow /wiki/Special%3ASearch
Disallow /wiki/Special%3ARecentChangesLinked
Disallow /wiki/Special%3ARecentChangesLinked
Disallow /wiki/Special%3AWhatLinksHere
Disallow /wiki/Special%3ASpecialPages
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /themes/
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips/
Disallow /node/add/
Disallow /search/
Disallow /user/

Other Records

Field Value
crawl-delay 3

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

the knowledge ai

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

webreaper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webcopier v3.2a

Rule Path
Disallow /

webcapture 2.0

Rule Path
Disallow /

webcapture 3.0

Rule Path
Disallow /

webcopier v.2.2

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

httrack 3.0x

Rule Path
Disallow /

psbot

Rule Path
Disallow /

snapbot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

superbot/4.7

Rule Path
Disallow /

backstreet browser

Rule Path
Disallow /

backstreet browser
discobot/1.1

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.orafaq.com/sitemap.xml