4chan thread archiver

Discussion in 'Your Shitty Projects' started by armucat, Apr 27, 2012.

Encyclopedia Dramatica Forums
A very friendly community
  1. armucat

    armucat
    Expand Collapse
    Dramacrat

    Joined:
    Oct 31, 2011
    Messages:
    20
    Yeah so I wrote one and now I gotta tell people about it. See the 4charc section of my wiki userpage. link Sugestions? Complaints? Feedback?
     
  2. xy0xy1

    xy0xy1
    Expand Collapse
    EDF Hero

    Joined:
    Dec 8, 2011
    Messages:
    1,912
    Occupation:
    kissin where it smells funny
    Home Page:
    are there limits of images and replies archived?

    what format will the archived threads be kept? a webpage?
     
  3. armucat

    armucat
    Expand Collapse
    Dramacrat

    Joined:
    Oct 31, 2011
    Messages:
    20
    At the moment I'm archiving the stickied thread in /b/ which has 3163 posts and 783 image replies omitted. In theory the only limit should be what the hardware on your computer can keep up with. You don't even have much to wory about there since this computer I'm using is quite old.

    The archived threads are saved as html with the board links, advertisments, and comment submition section stripped off.
     
  4. armucat

    armucat
    Expand Collapse
    Dramacrat

    Joined:
    Oct 31, 2011
    Messages:
    20
    Moot has just announced some major html rewrites to the site. Expect an updated version of 4charc to be released within a day of the new html taking affect.
     
  5. ge5undhe17

    ge5undhe17
    Expand Collapse
    Girlvinyl

    Joined:
    Jul 15, 2011
    Messages:
    7,019
    Occupation:
    Lab Tech
    Cool program! But isn't it the same as saving the thread normally using the browser?

    Do you have an SVN page for the software, I just want to see how it works/feels etc
     
  6. armucat

    armucat
    Expand Collapse
    Dramacrat

    Joined:
    Oct 31, 2011
    Messages:
    20

    There's a few differences. For one thing saving the thread misses any posts made after that point. Then to grab all the images from the thread would take an extra step and a browser plugin. To have the thumbs in the thread link to those full sized images the saved page would require some manual editing. All of this would take time and effort to acomplish manualy and wouldn't yield as good of a result. With the archiver just copy paste in the thread link and go find something else to do. On top of that the script can monitor a huge number of threads simultaneously.

    There's really no point in setting up an svn since even if the code was left split in seperate files there would only be 4 and the whole script is only 38kb in size. As for geting a feel for the program just install autohotkey then right click on 4charc.ahk and select run. The script runs straight from the file and the interface can be opened without curl. It just won't be able to monitor any threads. The default interface is the quick one. Type full in the text box and press return to see the full interface. A heads up I'm not a fan of flashy interfaces. I'm far more concerned with making stuff work well.
     
  7. Akula

    Akula
    Expand Collapse
    EDF Hero

    Joined:
    Jul 19, 2011
    Messages:
    1,586
    Occupation:
    n/a
    Home Page:
    Nice. I plan on using this eventually.
     
  8. xy0xy1

    xy0xy1
    Expand Collapse
    EDF Hero

    Joined:
    Dec 8, 2011
    Messages:
    1,912
    Occupation:
    kissin where it smells funny
    Home Page:
    wait wait. you mean, the full sized images right

    fuck yes
     
  9. armucat

    armucat
    Expand Collapse
    Dramacrat

    Joined:
    Oct 31, 2011
    Messages:
    20
    Yep. It saves the full sized images in the _files folder along with the thumbnails.
     
  10. armucat

    armucat
    Expand Collapse
    Dramacrat

    Joined:
    Oct 31, 2011
    Messages:
    20
    4charc 1.1.0 is now up. If you use this script you need to update. Older versions won't work with the new 4chan html.
     
  11. Tom

    Tom
    Expand Collapse
    Ultra Furry

    Joined:
    Jul 15, 2011
    Messages:
    2,326
    This is actually really nice, thanks for making this.
     
  12. Akula

    Akula
    Expand Collapse
    EDF Hero

    Joined:
    Jul 19, 2011
    Messages:
    1,586
    Occupation:
    n/a
    Home Page:
    Now I can easily save all the furry porn dumps.
     
  13. PerpetuallyAroused

    PerpetuallyAroused
    Expand Collapse
    Girlvinyl

    Joined:
    Jul 18, 2011
    Messages:
    5,373
    Occupation:
    Superhero Scientist
    archive only posts related to gaben plx.
     
  14. armucat

    armucat
    Expand Collapse
    Dramacrat

    Joined:
    Oct 31, 2011
    Messages:
    20
    Thanks you guys. Remember if there's any features you'ld like to see I'm quite open to sugestions.

    Now it's gaben time.
    [​IMG]
     
  15. PerpetuallyAroused

    PerpetuallyAroused
    Expand Collapse
    Girlvinyl

    Joined:
    Jul 18, 2011
    Messages:
    5,373
    Occupation:
    Superhero Scientist
    too much promethazine
     
  16. armucat

    armucat
    Expand Collapse
    Dramacrat

    Joined:
    Oct 31, 2011
    Messages:
    20
    Version 1.1.1 of 4charc is out with an important patch.

    A change to the 4chan 404 page html has rendered prior versions of gps archiver and 4charc unable to detect thread 404s. It's imperative you update gps archiver. If you keep using an old version of gps archiver your hard drive will be packed full with the downloaded images as none of the temp files will be deleted. For now i've patched the script to work with the new html so I can get the but fix out quickly. Expect the next release to have protection written in so this can never happen again.
     
  17. bling bling

    bling bling
    Expand Collapse
    Dramacrat

    Joined:
    Jul 19, 2012
    Messages:
    163
    this shit awsom yo