Welcome, Guest. Please login or register.
Did you miss your activation email?

Login with username, password and session length

 
Advanced search

876875 Posts in 32834 Topics- by 24278 Members - Latest Member: aetherX

May 18, 2013, 12:19:46 AM
TIGSource ForumsCommunityCompetitionsOld CompetitionsAssemblee: Part 1Assembleech - The Assemblee Link Leech (19/12 update)
Pages: 1 [2] 3 4 5
Print
Author Topic: Assembleech - The Assemblee Link Leech (19/12 update)  (Read 16605 times)
Tesse
Level 0
**



View Profile
« Reply #15 on: November 23, 2009, 02:27:00 PM »

So cool !  Hand Thumbs Up Left Hand Thumbs Up Left Hand Thumbs Up Left
And amazing to see THAT much content !! Addicted
Logged

Please be friend of me.
Sos
Level 8
***


[cluck]


View Profile WWW Email
« Reply #16 on: November 23, 2009, 02:32:26 PM »

And amazing to see THAT much content !!

I hope the games will be as numerous as that Smiley
Logged

Sos
Level 8
***


[cluck]


View Profile WWW Email
« Reply #17 on: November 25, 2009, 10:37:54 AM »

Just an ordinary update bump. (Updated just now)

Sorry i don't update often but the script is really heavy. Sometimes it works after 3-4 tries (returns "500 - Internal Server Eror, please contact the administrator at [email protected]")
Logged

Melly
Level 10
*****


This is how being from "da hood" is like, right?


View Profile
« Reply #18 on: November 25, 2009, 10:44:35 AM »

Sexylicious. Stickied, for great justice.
Logged

Feel free to disregard the above.
Games: Minus / Action Escape Kitty
Sos
Level 8
***


[cluck]


View Profile WWW Email
« Reply #19 on: November 25, 2009, 01:36:56 PM »

Thanks Melly Smiley

That'll save some useless bumping
Logged

nitram_cero (2bam)
Level 10
*****


DIY


View Profile WWW Email
« Reply #20 on: November 26, 2009, 06:28:36 PM »

I made a script to download everything from this script to the proper author sub-folder so it's compatible with the Indie Asset Organizer.

I just need confirmation if Sos is willing to modify his script a bit for that.

I'm building it for Windows. It's open-source and depends mostly on "wget" so Mac/Linux users could build it too.
Thanks to wget's parameter "-c", you can continue if a download fails/gets broken, and I think it doesn't redownload once it did ok, so you can recall the script.

Regards.

Logged

2BAM.com indie games
Sos
Level 8
***


[cluck]


View Profile WWW Email
« Reply #21 on: November 27, 2009, 03:15:57 AM »

I made a script to download everything from this script to the proper author sub-folder so it's compatible with the Indie Asset Organizer.

I just need confirmation if Sos is willing to modify his script a bit for that.

I'd be delighted to, but you didn't say what do i need to change.
Logged

nitram_cero (2bam)
Level 10
*****


DIY


View Profile WWW Email
« Reply #22 on: November 27, 2009, 07:20:45 AM »

I sent you 2 PMs yesterday, haven't you received them?
Perhaps if you're not too busy we could work together a way to easily integrate it with the IAO, dunno.

If you can manage to get the author with the link I can make a tool to download it in the correct folders.
Instead of HTML a raw output of

Quote
AUTHOR1
LINK_A
AUTHOR1
LINK_B
AUTHOR2
LINK_C
....

If you go to the first post, I found a pattern:

In the first TD tag that is of class "windowbg" you go
TD class=windowbg -> table -> tr -> td -> b -> a -> innerText
And that's the author's name  Smiley

Code:
<td class="windowbg">
<table width="100%" cellpadding="5" cellspacing="0" style="table-layout: fixed;">
<tr>
<td valign="top" width="16%" rowspan="2" style="overflow: hidden;">
<b><a href="http://forums.tigsource.com/index.php?action=profile;u=3670" title="View the profile of Sos">Sos</a></b>
<div class="smalltext">

Let me know what you think!

Regards! Beer!




Ok, I did a preliminary for the utility. It depends on wget.

If you want to do it, I just need this format:
Quote
author\n
url\n
author\n
url\n

It needs a "\n" instead of <BR>, so I can load the file getting line by line as a raw text file.

Thanks and best regards!

Sorry for the misunderstanding Smiley
Logged

2BAM.com indie games
Sos
Level 8
***


[cluck]


View Profile WWW Email
« Reply #23 on: November 27, 2009, 07:38:50 AM »

Sorry, didn't notice them. It seems a tough job to extract authors name, I will try it tho.
Logged

nitram_cero (2bam)
Level 10
*****


DIY


View Profile WWW Email
« Reply #24 on: November 27, 2009, 07:44:22 AM »

Check these out:
http://keithdevens.com/software/phpxml
http://php.net/manual/en/book.xml.php
http://www.phpclasses.org/browse/file/17412.html
Logged

2BAM.com indie games
Sos
Level 8
***


[cluck]


View Profile WWW Email
« Reply #25 on: November 27, 2009, 02:25:25 PM »

These are XML parsers. Forums output some major HTML mess (I dare you to take a peek Tongue)
Logged

nitram_cero (2bam)
Level 10
*****


DIY


View Profile WWW Email
« Reply #26 on: November 27, 2009, 03:52:12 PM »

But HTML is like XML, it will parse it, believe me, I did it a thousand times (not in PHP though)

It's not that messy, really. As I told you, if you search for the first TD with the property "class" = "windowbg", you can easily get the first post.
Logged

2BAM.com indie games
Sos
Level 8
***


[cluck]


View Profile WWW Email
« Reply #27 on: November 27, 2009, 05:39:11 PM »

I'd rather use just preg_match to get the text between '"View the profile of' and '">', however the hard part is to get it to assign post to poster.
Logged

nitram_cero (2bam)
Level 10
*****


DIY


View Profile WWW Email
« Reply #28 on: November 27, 2009, 05:49:28 PM »

Oh but I was talking about something way more simple:
Just search for the the original poster (1st post) and all the links in the thread are assumed to be from him Smiley

I mean, it's heuristic but pretty reasonable.
Logged

2BAM.com indie games
Sos
Level 8
***


[cluck]


View Profile WWW Email
« Reply #29 on: November 27, 2009, 06:17:37 PM »

i can't since I rely on pages, not threads (some got more of them).

Anyways, let's get all this tech mumbo-jumbo out of this thread, I'll do my best
Logged

Pages: 1 [2] 3 4 5
Print
Jump to:  

Theme orange-lt created by panic