1. If you can't use the support forum then you can contact the admin for support via "admin@theforumwheel.com".
    Dismiss Notice

THE FORUM WHEEL IS LISTING OUR SITES ON GOOGLE!

Discussion in 'Forum Owners' started by ForumAdmin, Jul 8, 2015.

  1. ForumAdmin

    ForumAdmin Member

    Joined:
    Jul 8, 2015
    Posts:
    11
    Likes Received:
    12
    Gender:
    Male
    Location:
    Swansea, UK
    Why are search engines allowed to index the /forums directory?

    I had a site listed on The Forum Wheel but due to this issue have had to disable it, I now have a Google listing against The forum Wheel for all to see. Obviously I don't want it public knowledge that some members are being paid to post on our forums. :(

    Really annoyed about this!
     
    ForumAdmin, Jul 8, 2015
    #1
  2. Hugop

    Hugop Active Member

    Joined:
    Jun 13, 2015
    Posts:
    42
    Likes Received:
    23
    Gender:
    Male
    Seems like Ken needs to make a crawler list.

    I found the TheFormWheel site on the third page by searching your domain on Google. :p
     
    Hugop, Jul 8, 2015
    #2
  3. ForumAdmin

    ForumAdmin Member

    Joined:
    Jul 8, 2015
    Posts:
    11
    Likes Received:
    12
    Gender:
    Male
    Location:
    Swansea, UK
    Exactly!

    You don't have to just Google my domain name either.

    The forum wheel uses the following robots.txt:
    User-agent: *
    Disallow: /admin/

    User-agent: *
    Disallow: /dashboard/

    User-agent: *
    Disallow: /cron/

    User-agent: *
    Disallow: /email/

    User-agent: *
    Disallow: /error/

    User-agent: *
    Disallow: /activated/

    User-agent: *
    Disallow: /invite/

    User-agent: *
    Disallow: /welcome/

    postloop use the following:
    User-agent: *
    Disallow: /blogs
    Disallow: /blogs/
    Disallow: /blogs/*
    Disallow: /forums
    Disallow: /forums/
    Disallow: /forums/*
    Disallow: /sites
    Disallow: /sites/
    Disallow: /sites/*
    Disallow: /users
    Disallow: /users/
    Disallow: /users/*

    As you can see, postloop do not allow access to their /forums directory.
     
    ForumAdmin, Jul 8, 2015
    #3
    Hugop likes this.
  4. KenBrace

    KenBrace Well-Known Member Administrator

    Joined:
    Apr 11, 2015
    Posts:
    1,163
    Likes Received:
    705
    You've brought up a legit concern @ForumAdmin. The "/forums/" directory has been added to our robots.txt file. Once Google updates the listing that page should be removed from their database.

    I apologize for the inconvenience.
     
    Last edited: Jul 8, 2015
    KenBrace, Jul 8, 2015
    #4
    Hugop likes this.
  5. KenBrace

    KenBrace Well-Known Member Administrator

    Joined:
    Apr 11, 2015
    Posts:
    1,163
    Likes Received:
    705
    I submitted a removal request to Google yesterday to expedite the process. I just now checked and it seems to have been removed.
     
    KenBrace, Jul 9, 2015
    #5
    fmoliveira and Fawk like this.
  6. ForumAdmin

    ForumAdmin Member

    Joined:
    Jul 8, 2015
    Posts:
    11
    Likes Received:
    12
    Gender:
    Male
    Location:
    Swansea, UK
    Thank you Ken.
     
    ForumAdmin, Jul 10, 2015
    #6

Share This Page