Making DBP download data from a URL and use it?

Author

Message

Sid Sinister

18

Years of Service

User Offline

Joined: 10th Jul 2005

Location:

Posted: 7th Nov 2008 04:26

Link

Maybe this has a simple fix, but I have never thought about doing something like this so I wouldn't know. But is it possible to download a .txt file from a URL by using DBP commands? If not, could I do it in DarkGDK?

"If I have seen a little further it is by standing on the shoulders of Giants" - Isaac Newton
-Computer Animation Major @Baker.edu-

Back to top

Profile PM Email

Sergey K

20

Years of Service

User Offline

Joined: 4th Jan 2004

Location:

Posted: 7th Nov 2008 04:31

Link

yeah. search for download url function in the forums. there are also lots of plugins for that 2.
u are able 2 download whatever u want, not just txt file.

Get DBP stuff here! - (plugins/models/scripts and more!)

Back to top

Profile PM Website

Sid Sinister

18

Years of Service

User Offline

Joined: 10th Jul 2005

Location:

Posted: 7th Nov 2008 05:18 Edited at: 7th Nov 2008 06:19

Link

Funny, you made that plugin! Lol.

I found one thread and it led me on a rabbit trail. I stumbled upon this code and am now trying to get it to work. It runs, but I just don't get the file download...

DLFile("http://dataphone.games.tucows.com/files/","FishTycoonSetup.exe")

Function DLFile(Url$,FileName$)

If File Exist(FileName$)=1 then Delete File FileName$

Load DLL "wininet.dll", 1
   Call DLL 1,"InternetAttemptConnect",0
   Con=Call DLL (1,"InternetCheckConnectionA",URL$,1)

If Con=0
      Print "Internet connection not found!"
      End
   EndIf

INet = Call DLL (1,"InternetOpenA","media",0,"","",0)
   URL  = Call DLL (1,"InternetOpenUrlA",INet,URL$+FileName$,"",0,0,0)

#Constant HTTP_QUERY_CONTENT_LENGTH=5
   Make MemBlock 2,16
   BufferI as dword
   BufferSize as dword
   BufferI      = Get MemBlock Ptr(2)
   BufferSize  = Make Memory(4)
   *BufferSize = Get MemBlock Size(2)
   QueryInfo   = Call DLL (1,"HttpQueryInfoA",url,HTTP_QUERY_CONTENT_LENGTH,BufferI,BufferSize,0)

BufferLength=*BufferSize

FSize$=""
   For F=1 to BufferLength : FSize$=FSize$+CHR$(MemBlock Byte(2,F-1)) : next F
   FSize=Val(FSize$)
   If FSize>1000 then FSize$=Str$(FSize/1024)+" kb"

Make Memblock 1,1024
   Buffer = Get MemBlock Ptr(1)
   Size   = Make Memory(4)
   Downloaded=0

Open to Write 1,FileName$
      Repeat
         Call DLL 1,"InternetReadFile",URL,Buffer,1024,Size
         S=*Size
         For I=0 to S-1 : Write Byte 1,Memblock Byte(1,I) : Next I
         CLS
         Print "Downloading: "+Url$+FileName$
         If Timer()>SpeedTimer+1000
            Speed=Downloaded-Downloaded2
            Speed$=Str$((Speed)/1024)+" kb/s"
            SpeedTimer=Timer()
            Downloaded2=Downloaded
         EndIf
         Print "Speed      : "+Speed$
         If QueryInfo=1
            Progress$=Str$((downloaded*100)/fsize)+"%"
            Print "File Size  : "+Fsize$
            Print "Progress   : "+Progress$
         EndIf
         Inc Downloaded,1024
      Until S=0
   Close File 1

Call DLL 1,"InternetCloseHandle",URL
   Call DLL 1,"InternetCloseHandle",INet

Delete Memory Size
   Delete MemBlock 1
   Delete MemBlock 2
   Delete DLL 1

EndFunction

+ Code Snippet

DLFile("http://dataphone.games.tucows.com/files/","FishTycoonSetup.exe")

Function DLFile(Url$,FileName$)

   If File Exist(FileName$)=1 then Delete File FileName$

   Load DLL "wininet.dll", 1
   Call DLL 1,"InternetAttemptConnect",0
   Con=Call DLL (1,"InternetCheckConnectionA",URL$,1)

   If Con=0
      Print "Internet connection not found!"
      End
   EndIf

   INet = Call DLL (1,"InternetOpenA","media",0,"","",0)
   URL  = Call DLL (1,"InternetOpenUrlA",INet,URL$+FileName$,"",0,0,0)

   #Constant HTTP_QUERY_CONTENT_LENGTH=5
   Make MemBlock 2,16
   BufferI as dword
   BufferSize as dword
   BufferI      = Get MemBlock Ptr(2)
   BufferSize  = Make Memory(4)
   *BufferSize = Get MemBlock Size(2)
   QueryInfo   = Call DLL (1,"HttpQueryInfoA",url,HTTP_QUERY_CONTENT_LENGTH,BufferI,BufferSize,0)

   BufferLength=*BufferSize

   FSize$=""
   For F=1 to BufferLength : FSize$=FSize$+CHR$(MemBlock Byte(2,F-1)) : next F
   FSize=Val(FSize$)
   If FSize>1000 then FSize$=Str$(FSize/1024)+" kb"

   Make Memblock 1,1024
   Buffer = Get MemBlock Ptr(1)
   Size   = Make Memory(4)
   Downloaded=0

   Open to Write 1,FileName$
      Repeat
         Call DLL 1,"InternetReadFile",URL,Buffer,1024,Size
         S=*Size
         For I=0 to S-1 : Write Byte 1,Memblock Byte(1,I) : Next I
         CLS
         Print "Downloading: "+Url$+FileName$
         If Timer()>SpeedTimer+1000
            Speed=Downloaded-Downloaded2
            Speed$=Str$((Speed)/1024)+" kb/s"
            SpeedTimer=Timer()
            Downloaded2=Downloaded
         EndIf
         Print "Speed      : "+Speed$
         If QueryInfo=1
            Progress$=Str$((downloaded*100)/fsize)+"%"
            Print "File Size  : "+Fsize$
            Print "Progress   : "+Progress$
         EndIf
         Inc Downloaded,1024
      Until S=0
   Close File 1

   Call DLL 1,"InternetCloseHandle",URL
   Call DLL 1,"InternetCloseHandle",INet

   Delete Memory Size
   Delete MemBlock 1
   Delete MemBlock 2
   Delete DLL 1

EndFunction

Edit: I saw Cattle Rustler mentioned XUpdate, but his site seems to be down for the moment.

"If I have seen a little further it is by standing on the shoulders of Giants" - Isaac Newton
-Computer Animation Major @Baker.edu-

Back to top

Profile PM Email

Sergey K

20

Years of Service

User Offline

Joined: 4th Jan 2004

Location:

Posted: 7th Nov 2008 13:49

Link

DLFile("http://dataphone.games.tucows.com/files/","FishTycoonSetup.exe")

"http://dataphone.games.tucows.com/files/" - i dont think such file is exist..

Get DBP stuff here! - (plugins/models/scripts and more!)

Back to top

Profile PM Website

Sid Sinister

18

Years of Service

User Offline

Joined: 10th Jul 2005

Location:

Posted: 8th Nov 2008 09:00

Link

Serg - I've inserted my own link and it still doesn't work

Windows - The reason I want to do this is because the browser war game I play, Tribal Wars, updates their world data and releases it to the public. Their are several websites and apps that take this world data and provide analysis on it.

The reason I need this URL thing to work is so I can get a poke at that data. I'm looking into XNA to do this for me, because I want some graphical things to come along with it, but OOP is killing me after using procedural for so long.

"If I have seen a little further it is by standing on the shoulders of Giants" - Isaac Newton
-Computer Animation Major @Baker.edu-

Back to top

Profile PM Email

Sergey K

20

Years of Service

User Offline

Joined: 4th Jan 2004

Location:

Posted: 8th Nov 2008 14:54

Link

why wont u try my Free DBP Plugin with lots of usefull functions inside..
http://gamegeeks.jarekull.se/html/gogaFree.htm
it got also a downloader function.

Get DBP stuff here! - (plugins/models/scripts and more!)

Back to top

Profile PM Website

the_winch

21

Years of Service

User Offline

Joined: 1st Feb 2003

Location: Oxford, UK

Posted: 8th Nov 2008 22:01

Link

Works for me. I did change the function so it doesn't stick the filename on the end of the url before trying to download it.

DLFile("http://upload.wikimedia.org/wikipedia/en/9/9d/Commons-logo-31px.png","logo.png")
load image "logo.png", 1, 1
box 100, 100, 200, 200
paste image 1, 150, 150, 1
wait key
end

Function DLFile(Url$,FileName$)

If File Exist(FileName$)=1 then Delete File FileName$

Load DLL "wininet.dll", 1
   Call DLL 1,"InternetAttemptConnect",0
   Con=Call DLL (1,"InternetCheckConnectionA",URL$,1)

If Con=0
      Print "Internet connection not found!"
      End
   EndIf

INet = Call DLL (1,"InternetOpenA","media",0,"","",0)
   URL  = Call DLL (1,"InternetOpenUrlA",INet,URL$,"",0,0,0)

#Constant HTTP_QUERY_CONTENT_LENGTH=5
   Make MemBlock 2,16
   BufferI as dword
   BufferSize as dword
   BufferI      = Get MemBlock Ptr(2)
   BufferSize  = Make Memory(4)
   *BufferSize = Get MemBlock Size(2)
   QueryInfo   = Call DLL (1,"HttpQueryInfoA",url,HTTP_QUERY_CONTENT_LENGTH,BufferI,BufferSize,0)

BufferLength=*BufferSize

FSize$=""
   For F=1 to BufferLength : FSize$=FSize$+CHR$(MemBlock Byte(2,F-1)) : next F
   FSize=Val(FSize$)
   If FSize>1000 then FSize$=Str$(FSize/1024)+" kb"

Make Memblock 1,1024
   Buffer = Get MemBlock Ptr(1)
   Size   = Make Memory(4)
   Downloaded=0

Open to Write 1,FileName$
      Repeat
         Call DLL 1,"InternetReadFile",URL,Buffer,1024,Size
         S=*Size
         For I=0 to S-1 : Write Byte 1,Memblock Byte(1,I) : Next I
         CLS
         Print "Downloading: "+Url$+FileName$
         If Timer()>SpeedTimer+1000
            Speed=Downloaded-Downloaded2
            Speed$=Str$((Speed)/1024)+" kb/s"
            SpeedTimer=Timer()
            Downloaded2=Downloaded
         EndIf
         Print "Speed      : "+Speed$
         If QueryInfo=1
            Progress$=Str$((downloaded*100)/fsize)+"%"
            Print "File Size  : "+Fsize$
            Print "Progress   : "+Progress$
         EndIf
         Inc Downloaded,1024
      Until S=0
   Close File 1

Call DLL 1,"InternetCloseHandle",URL
   Call DLL 1,"InternetCloseHandle",INet

Delete Memory Size
   Delete MemBlock 1
   Delete MemBlock 2
   Delete DLL 1

EndFunction

+ Code Snippet

DLFile("http://upload.wikimedia.org/wikipedia/en/9/9d/Commons-logo-31px.png","logo.png")
load image "logo.png", 1, 1
box 100, 100, 200, 200
paste image 1, 150, 150, 1
wait key
end

Function DLFile(Url$,FileName$)

   If File Exist(FileName$)=1 then Delete File FileName$

   Load DLL "wininet.dll", 1
   Call DLL 1,"InternetAttemptConnect",0
   Con=Call DLL (1,"InternetCheckConnectionA",URL$,1)

   If Con=0
      Print "Internet connection not found!"
      End
   EndIf

   INet = Call DLL (1,"InternetOpenA","media",0,"","",0)
   URL  = Call DLL (1,"InternetOpenUrlA",INet,URL$,"",0,0,0)

   #Constant HTTP_QUERY_CONTENT_LENGTH=5
   Make MemBlock 2,16
   BufferI as dword
   BufferSize as dword
   BufferI      = Get MemBlock Ptr(2)
   BufferSize  = Make Memory(4)
   *BufferSize = Get MemBlock Size(2)
   QueryInfo   = Call DLL (1,"HttpQueryInfoA",url,HTTP_QUERY_CONTENT_LENGTH,BufferI,BufferSize,0)

   BufferLength=*BufferSize

   FSize$=""
   For F=1 to BufferLength : FSize$=FSize$+CHR$(MemBlock Byte(2,F-1)) : next F
   FSize=Val(FSize$)
   If FSize>1000 then FSize$=Str$(FSize/1024)+" kb"

   Make Memblock 1,1024
   Buffer = Get MemBlock Ptr(1)
   Size   = Make Memory(4)
   Downloaded=0

   Open to Write 1,FileName$
      Repeat
         Call DLL 1,"InternetReadFile",URL,Buffer,1024,Size
         S=*Size
         For I=0 to S-1 : Write Byte 1,Memblock Byte(1,I) : Next I
         CLS
         Print "Downloading: "+Url$+FileName$
         If Timer()>SpeedTimer+1000
            Speed=Downloaded-Downloaded2
            Speed$=Str$((Speed)/1024)+" kb/s"
            SpeedTimer=Timer()
            Downloaded2=Downloaded
         EndIf
         Print "Speed      : "+Speed$
         If QueryInfo=1
            Progress$=Str$((downloaded*100)/fsize)+"%"
            Print "File Size  : "+Fsize$
            Print "Progress   : "+Progress$
         EndIf
         Inc Downloaded,1024
      Until S=0
   Close File 1

   Call DLL 1,"InternetCloseHandle",URL
   Call DLL 1,"InternetCloseHandle",INet

   Delete Memory Size
   Delete MemBlock 1
   Delete MemBlock 2
   Delete DLL 1

EndFunction

By way of demonstration, he emitted a batlike squeak that was indeed bothersome.

Back to top

Profile PM Website

Sid Sinister

18

Years of Service

User Offline

Joined: 10th Jul 2005

Location:

Posted: 9th Nov 2008 03:50 Edited at: 9th Nov 2008 04:23

Link

I tried your snippet the_winch, but all it runs, and then flashes a black screen and returns to the desktop. I don't know why it's not waiting for key or displaying the image. Odd... do you know what's going on?

EDIT: I'm on vista, but other DBP programs run just fine...

"If I have seen a little further it is by standing on the shoulders of Giants" - Isaac Newton
-Computer Animation Major @Baker.edu-

Back to top

Profile PM Email

calcyman

16

Years of Service

User Offline

Joined: 31st Aug 2007

Location: The Uncertainty Principle

Posted: 9th Nov 2008 16:43

Link

I believe this works:

+ Code Snippet

function DownloadFile(site as string, file as string)
load dll "urlmon.dll",253
   status = call dll(253, "URLDownloadToFileA", 0, site, file, 0, 0)
delete dll 253
endfunction status

The optomist's right, The pessimist's right.

Back to top

Profile PM Email

Sid Sinister

18

Years of Service

User Offline

Joined: 10th Jul 2005

Location:

Posted: 11th Nov 2008 06:25

Link

Why doesn't this work??

DLFile("http://en26.tribalwars.net/map/village.txt", "data.txt")
wait key
end

Function DLFile(Url$,FileName$)

If File Exist(FileName$)=1 then Delete File FileName$

Load DLL "wininet.dll", 1
   Call DLL 1,"InternetAttemptConnect",0
   Con=Call DLL (1,"InternetCheckConnectionA",URL$,1)

If Con=0
      Print "Internet connection not found!"
      End
   EndIf

INet = Call DLL (1,"InternetOpenA","media",0,"","",0)
   URL  = Call DLL (1,"InternetOpenUrlA",INet,URL$,"",0,0,0)

#Constant HTTP_QUERY_CONTENT_LENGTH=5
   Make MemBlock 2,16
   BufferI as dword
   BufferSize as dword
   BufferI      = Get MemBlock Ptr(2)
   BufferSize  = Make Memory(4)
   *BufferSize = Get MemBlock Size(2)
   QueryInfo   = Call DLL (1,"HttpQueryInfoA",url,HTTP_QUERY_CONTENT_LENGTH,BufferI,BufferSize,0)

BufferLength=*BufferSize

FSize$=""
   For F=1 to BufferLength : FSize$=FSize$+CHR$(MemBlock Byte(2,F-1)) : next F
   FSize=Val(FSize$)
   If FSize>1000 then FSize$=Str$(FSize/1024)+" kb"

Make Memblock 1,1024
   Buffer = Get MemBlock Ptr(1)
   Size   = Make Memory(4)
   Downloaded=0

Open to Write 1,FileName$
      Repeat
         Call DLL 1,"InternetReadFile",URL,Buffer,1024,Size
         S=*Size
         For I=0 to S-1 : Write Byte 1,Memblock Byte(1,I) : Next I
         CLS
         Print "Downloading: "+Url$+FileName$
         If Timer()>SpeedTimer+1000
            Speed=Downloaded-Downloaded2
            Speed$=Str$((Speed)/1024)+" kb/s"
            SpeedTimer=Timer()
            Downloaded2=Downloaded
         EndIf
         Print "Speed      : "+Speed$
         If QueryInfo=1
            Progress$=Str$((downloaded*100)/fsize)+"%"
            Print "File Size  : "+Fsize$
            Print "Progress   : "+Progress$
         EndIf
         Inc Downloaded,1024
      Until S=0
   Close File 1

Call DLL 1,"InternetCloseHandle",URL
   Call DLL 1,"InternetCloseHandle",INet

Delete Memory Size
   Delete MemBlock 1
   Delete MemBlock 2
   Delete DLL 1

EndFunction

+ Code Snippet

DLFile("http://en26.tribalwars.net/map/village.txt", "data.txt")
wait key
end

Function DLFile(Url$,FileName$)

   If File Exist(FileName$)=1 then Delete File FileName$

   Load DLL "wininet.dll", 1
   Call DLL 1,"InternetAttemptConnect",0
   Con=Call DLL (1,"InternetCheckConnectionA",URL$,1)

   If Con=0
      Print "Internet connection not found!"
      End
   EndIf

   INet = Call DLL (1,"InternetOpenA","media",0,"","",0)
   URL  = Call DLL (1,"InternetOpenUrlA",INet,URL$,"",0,0,0)

   #Constant HTTP_QUERY_CONTENT_LENGTH=5
   Make MemBlock 2,16
   BufferI as dword
   BufferSize as dword
   BufferI      = Get MemBlock Ptr(2)
   BufferSize  = Make Memory(4)
   *BufferSize = Get MemBlock Size(2)
   QueryInfo   = Call DLL (1,"HttpQueryInfoA",url,HTTP_QUERY_CONTENT_LENGTH,BufferI,BufferSize,0)

   BufferLength=*BufferSize

   FSize$=""
   For F=1 to BufferLength : FSize$=FSize$+CHR$(MemBlock Byte(2,F-1)) : next F
   FSize=Val(FSize$)
   If FSize>1000 then FSize$=Str$(FSize/1024)+" kb"

   Make Memblock 1,1024
   Buffer = Get MemBlock Ptr(1)
   Size   = Make Memory(4)
   Downloaded=0

   Open to Write 1,FileName$
      Repeat
         Call DLL 1,"InternetReadFile",URL,Buffer,1024,Size
         S=*Size
         For I=0 to S-1 : Write Byte 1,Memblock Byte(1,I) : Next I
         CLS
         Print "Downloading: "+Url$+FileName$
         If Timer()>SpeedTimer+1000
            Speed=Downloaded-Downloaded2
            Speed$=Str$((Speed)/1024)+" kb/s"
            SpeedTimer=Timer()
            Downloaded2=Downloaded
         EndIf
         Print "Speed      : "+Speed$
         If QueryInfo=1
            Progress$=Str$((downloaded*100)/fsize)+"%"
            Print "File Size  : "+Fsize$
            Print "Progress   : "+Progress$
         EndIf
         Inc Downloaded,1024
      Until S=0
   Close File 1

   Call DLL 1,"InternetCloseHandle",URL
   Call DLL 1,"InternetCloseHandle",INet

   Delete Memory Size
   Delete MemBlock 1
   Delete MemBlock 2
   Delete DLL 1

EndFunction

"If I have seen a little further it is by standing on the shoulders of Giants" - Isaac Newton
-Computer Animation Major @Baker.edu-

Back to top

Profile PM Email

Sorry your browser is not supported!

DarkBASIC Professional Discussion / Making DBP download data from a URL and use it?