[Free Add-on ] Robots 1.6

Disallows robots from indexing your site unless explicitly allowed.

  1. Caldexi
    Compatible XF Versions:
    • 1.2
    • 1.3
    • 1.4
    • 1.5
    Robots
    1.5
    Description:
    Disallows robots from indexing your site unless explicitly allowed.
    (Robots link in Visitors tab)
    Bj5dYwQ.jpg
    (Example of Robots page)
    q1mWIsZ.jpg
    (Example of Options page)
    VVnbvIU.jpg
    (Example of User Group Permissions)
    Do03KsI.jpg

    Features:
    • All phrases start with robots_ for your convenience.
    Installation:
    1. Download robots_v1.5.zip and unzip it.
    2. Upload the Andy folder to your server. The correct location is library/Andy.
    3. From your Admin Control Panel, go to the "Install Add-on" page.
    4. Upload the addon-Robots_v1.5.xml file.
    5. Click the Install Add-on button.
    Setup:

    Set the Unregistered / Unconfirmed and Registered group permissions to Allow. The Allow setting means the Robots add-on will function for that user group.

    Questions and Answers:

    Q: What is the purpose of this add-on?
    A: Lots of robots crawling your forum will slow it down.

    Q: I noticed a robot crawling my site but it's identified as a guest.
    A: You need to add the name to the Robot Names field in the Options.

    Q: What happens if a robot which is not allowed comes to my site?
    A: It receives a blank page.

    Q: Why not use the robots.txt file to restrict robots?
    A: Because 99% of all robots ignore this file.

    Database modifications:

    This add-on will create a table called xf_robots in your database.

    Installation:
    1. Download robots_v1.6.zip and unzip it.
    2. Upload the Andy folder to your server. The correct location is library/Andy.
    3. From your Admin Control Panel, go to the "Install Add-on" page.
    4. Upload the addon-Robots_v1.6.xml file
    5. Click the Install Add-on button.
    Lemur9099, Bouffi, feezle and 7 others like this.

Recent Updates

  1. See description