Loading...
 
Skip to main content

Features / Usability

Forum List Topic List

Forums » Features / Usability » traffic caused by google search robots
 
Thread actions
Print this page
  • Print all pages

    • traffic caused by google search robots

    Posted by wavecrest posts: 3 Germany

    Hi folks,

    in the last few months I had unbelievable traffic caused by search machines.
    In February the google robots were responsible for 4 Gigabyte traffic! This is far more
    than all of my users generated! 😑

    Do you have an idea how to reduce this traffic?? ❓

    On my normal homepage I use a metatag like this:
    META NAME="REVISIT-AFTER" CONTENT="31 DAYS"

    Can I do the same with my tikiwiki-system?

    (My version: Tiki-Wiki-1-8-6 // PHP 4.4.2 // Linux // Apache)

    Many thanks,

    Wavecrest

    Reads: 1918
    Posted by sylvie greverend posts: 1092

    You can do it by changing the smarty template header.tpl and adding your line. The file is in the directory templates/styles/your_style where you_style is moreneat... or if not in the default location templates

    You can also adjust the robots.txt file
    sylvie


    Posted by wavecrest posts: 3 Germany

    Thank you!

    I changed the header.tpl - I hope it will work! 😁

    What kind of text do I add to the robot.txt file?

    Bye, Wavecrest.

    Posted by sylvie greverend posts: 1092


    > What kind of text do I add to the robot.txt file?
    It wouldn' do the same effect. But you can avoid browser to go in useless pages and retruce traffic

    You have already in robots.txt in your tikwiki root. But in 1.8., it is not updated. Pick the one from 1.9 http://cvs.sourceforge.net/viewcvs.py/tikiwiki/tiki/robots.txt?rev=1.8&view=log a little better but still nor perfect. Follow the instruction at the top if you are in a subdirectory . Add other links

    sylvie


    Posted by wavecrest posts: 3 Germany

    Thank You!! 😀 I think your recommendation is very useful - Google caused the traffic especially with the file "tiki-pagehistory.php".

    My installation is in the subdirectory "methoden" so I modified
    the robots.txt in this way:

    I hope everything works now!! 😀

    Bye, Wavecrest.

    content of "MY" robtots.txt now:

    User-agent: *
    Disallow: /methoden/CVS/
    Disallow: /methoden/lib/
    Disallow: /methoden/doc/
    Disallow: /methoden/dump/
    Disallow: /methoden/img/
    Disallow: /methoden/templates/
    Disallow: /methoden/templates_c/
    Disallow: /methoden/var/
    Disallow: /methoden/lang/
    Disallow: /methoden/backups/
    Disallow: /methoden/bin/
    Disallow: /methoden/db/
    Disallow: /methoden/games/
    Disallow: /methoden/images/
    Disallow: /methoden/maps/
    Disallow: /methoden/modules/
    Disallow: /methoden/popups/
    Disallow: /methoden/temp/
    Disallow: /methoden/tests/
    Disallow: /methoden/tikimovies/
    Disallow: /methoden/tiki-install.php
    Disallow: /methoden/tiki-admin.php
    Disallow: /methoden/tiki-editpage.php
    Disallow: /methoden/tiki-print.php
    Disallow: /methoden/tiki-print_article.php
    Disallow: /methoden/tiki-print_blog_post.php
    Disallow: /methoden/tiki-print_multi_pages.php
    Disallow: /methoden/tiki-print_pages.php
    Disallow: /methoden/tiki-pagehistory.php
    Disallow: /methoden/tiki-backlinks.php
    Disallow: /methoden/tiki-likepages.php
    Disallow: /methoden/tiki-listpages.php
    Disallow: /methoden/tiki-lastchanges.php
    Disallow: /methoden/tiki-orphan_pages.php
    Disallow: /methoden/tiki-register.php
    Disallow: /methoden/tiki-login_scr.php
    Disallow: /methoden/tiki-view_cache.php
    Disallow: /methoden/tiki-user_information.php
    Disallow: /methoden/get_strings.php
    Disallow: /methoden/tiki-index.php?page=SandBox
    Disallow: /methoden/CVS/
    Disallow: /methoden/lib/
    Disallow: /methoden/doc/
    Disallow: /methoden/dump/
    Disallow: /methoden/img/
    Disallow: /methoden/templates/
    Disallow: /methoden/templates_c/
    Disallow: /methoden/var/
    Disallow: /methoden/lang/
    Disallow: /methoden/backups/
    Disallow: /methoden/bin/
    Disallow: /methoden/db/
    Disallow: /methoden/games/
    Disallow: /methoden/images/
    Disallow: /methoden/maps/
    Disallow: /methoden/modules/
    Disallow: /methoden/popups/
    Disallow: /methoden/temp/
    Disallow: /methoden/tests/
    Disallow: /methoden/tikimovies/
    Disallow: /methoden/tiki-install.php
    Disallow: /methoden/tiki-admin.php
    Disallow: /methoden/tiki-editpage.php
    Disallow: /methoden/tiki-print.php
    Disallow: /methoden/tiki-print_article.php
    Disallow: /methoden/tiki-print_blog_post.php
    Disallow: /methoden/tiki-print_multi_pages.php
    Disallow: /methoden/tiki-print_pages.php
    Disallow: /methoden/tiki-pagehistory.php
    Disallow: /methoden/tiki-backlinks.php
    Disallow: /methoden/tiki-likepages.php
    Disallow: /methoden/tiki-listpages.php
    Disallow: /methoden/tiki-lastchanges.php
    Disallow: /methoden/tiki-orphan_pages.php
    Disallow: /methoden/tiki-register.php
    Disallow: /methoden/tiki-login_scr.php
    Disallow: /methoden/tiki-view_cache.php
    Disallow: /methoden/tiki-user_information.php
    Disallow: /methoden/get_strings.php
    Disallow: /methoden/tiki-index.php?page=SandBox
    Disallow: /methoden/tiki-register.php
    Disallow: /methoden/tiki-login_scr.php