Be Excellent To Each Other

And, you know, party on. Dude.

All times are UTC [ DST ]




Reply to topic  [ 18 posts ] 
Author Message
 Post subject: Downloading entire websites
PostPosted: Mon Jun 29, 2009 15:46 
User avatar
Excellent Member

Joined: 30th Mar, 2008
Posts: 5924
Location: Stockport - The Jewel in the Ring
Is there a tool that will crawl all of a website and make a copy of it on a local drive? Basically, nab the HTML, plus any external CSS, Javascript files and images?

For completely legitimate reasons - I'm needing to replicate a site locally that lives in a hosted CMS.

_________________
Mint To Be Stationery - Looking for a Secret Santa gift? Try our online shops at Mint To Be.

Book me in the Face | Tweet me. Tweet me like a British nanny.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 15:47 
SupaMod
User avatar
Commander-in-Cheese

Joined: 30th Mar, 2008
Posts: 49237
You've immediately got a problem - the CMS DB will control most of the site structure.

_________________
GoddessJasmine wrote:
Drunk, pulled Craster's pork, waiting for brdyime story,reading nuts. Xz


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 15:48 
SupaMod
User avatar
Est. 1978

Joined: 27th Mar, 2008
Posts: 69689
Location: Your Mum
Craster wrote:
You've immediately got a problem - the CMS DB will control most of the site structure.

Er, so?

_________________
Grim... wrote:
I wish Craster had left some girls for the rest of us.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 15:50 
User avatar
Excellent Member

Joined: 30th Mar, 2008
Posts: 5924
Location: Stockport - The Jewel in the Ring
Don't care if it ends up as a flat directory TBH. It is about 30 pages, and I don't really want to View Source it all.

_________________
Mint To Be Stationery - Looking for a Secret Santa gift? Try our online shops at Mint To Be.

Book me in the Face | Tweet me. Tweet me like a British nanny.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 15:50 
SupaMod
User avatar
Commander-in-Cheese

Joined: 30th Mar, 2008
Posts: 49237
Ooh, good point. Er.

Nope, as you were. Carry on.

_________________
GoddessJasmine wrote:
Drunk, pulled Craster's pork, waiting for brdyime story,reading nuts. Xz


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 15:50 
SupaMod
User avatar
Est. 1978

Joined: 27th Mar, 2008
Posts: 69689
Location: Your Mum
Anyway, IE6 used to do it (you used to be able to save web pages [x] number of links deep), but it looks like IE7 doesn't.
I've not used any specific software, but I think Gaywood has.

_________________
Grim... wrote:
I wish Craster had left some girls for the rest of us.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 15:51 
User avatar
I forgot about this - how vain

Joined: 30th Mar, 2008
Posts: 5979
Unix/Linux/Mac has wget (maybe the vista terminal has a version too?).

I've never got it to work properly, but its job is to do that.

_________________
Curiosity wrote:
The Rev Owen wrote:
Is there a way to summon lave?

Faith schools, scientologists and 2-D platform games.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 15:53 
User avatar

Joined: 30th Mar, 2008
Posts: 32624
Dr Lave wrote:
Unix/Linux/Mac has wget (maybe the vista terminal has a version too?).
Yes, wget would be my port of call too. Windows GUI version: http://www.jensroesner.de/wgetgui/. Warning: it has an interface only a mother could love.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 15:57 
User avatar
Excellent Member

Joined: 30th Mar, 2008
Posts: 5924
Location: Stockport - The Jewel in the Ring
OK, playing with that now.

And I thought *I* was bad at interface design.

_________________
Mint To Be Stationery - Looking for a Secret Santa gift? Try our online shops at Mint To Be.

Book me in the Face | Tweet me. Tweet me like a British nanny.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 15:59 
User avatar

Joined: 30th Mar, 2008
Posts: 32624
Plissken wrote:
And I thought *I* was bad at interface design.
Brilliant, isn't it? It's the command line core wget client (which has command line flags spanning almost every letter of the alphabet), remixed and splattered at what looks like a VB control.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 16:06 
User avatar

Joined: 30th Mar, 2008
Posts: 14324
Location: Shropshire, UK
WinHTTrack from http://www.httrack.com/ does everything you need.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 16:12 
User avatar
Gogmagog

Joined: 30th Mar, 2008
Posts: 48828
Location: Cheshire
If i were to want to do it, and then remove it from a server, what would have to be done?

_________________
Mr Chris wrote:
MaliA isn't just the best thing on the internet - he's the best thing ever.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 16:14 
SupaMod
User avatar
Est. 1978

Joined: 27th Mar, 2008
Posts: 69689
Location: Your Mum
MaliA wrote:
If i were to want to do it, and then remove it from a server, what would have to be done?

Bit confused, mate. Do you run the website?

_________________
Grim... wrote:
I wish Craster had left some girls for the rest of us.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 16:58 
User avatar
baron of techno

Joined: 30th Mar, 2008
Posts: 24136
Location: fife
Please do not pick at the hive brain.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 17:00 
User avatar
Gogmagog

Joined: 30th Mar, 2008
Posts: 48828
Location: Cheshire
Grim... wrote:
MaliA wrote:
If i were to want to do it, and then remove it from a server, what would have to be done?

Bit confused, mate. Do you run the website?


Yes.

EDIT: Nevermind, alternative solution came to mind.

_________________
Mr Chris wrote:
MaliA isn't just the best thing on the internet - he's the best thing ever.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 17:03 
SupaMod
User avatar
Est. 1978

Joined: 27th Mar, 2008
Posts: 69689
Location: Your Mum
Well then, use one of the programs above and then replace the landing page with something else, and rename the folder the old website sat in.
Unfortunately the website will still exist because for some reason search engines are allowed to carry on with the blatantly illegal practice of copying all your stuff and storing it elsewhere, so you'd have to talk to them, too.
Here is Google's page, for instance.

_________________
Grim... wrote:
I wish Craster had left some girls for the rest of us.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 17:24 
User avatar
Gogmagog

Joined: 30th Mar, 2008
Posts: 48828
Location: Cheshire
Grim... wrote:
Well then, use one of the programs above and then replace the landing page with something else, and rename the folder the old website sat in.
Unfortunately the website will still exist because for some reason search engines are allowed to carry on with the blatantly illegal practice of copying all your stuff and storing it elsewhere, so you'd have to talk to them, too.
Here is Google's page, for instance.


Cheers, boss. Much obliged.

_________________
Mr Chris wrote:
MaliA isn't just the best thing on the internet - he's the best thing ever.


Top
 Profile  
 
 Post subject: Re: Downloading entire websites
PostPosted: Mon Jun 29, 2009 20:12 
8-Bit Champion
User avatar
Two heads are better than one

Joined: 16th Apr, 2008
Posts: 14512
In the past i've used "Teleport pro" to download and mirror a whole website locally

I'm sure it used to be a shareware type program but looks like its now commercial although you can get a demo

http://www.tenmax.com/teleport/pro/home.htm


Top
 Profile  
 
Display posts from previous:  Sort by  
Reply to topic  [ 18 posts ] 

All times are UTC [ DST ]


Who is online

Users browsing this forum: Columbo, Majestic-12 [Bot], Mimi, PRISM and 0 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search within this thread:
You are using the 'Ted' forum. Bill doesn't really exist any more. Bogus!
Want to help out with the hosting / advertising costs? That's very nice of you.
Are you on a mobile phone? Try http://beex.co.uk/m/
RIP, Owen. RIP, MrC. RIP, Dimmers.

Powered by a very Grim... version of phpBB © 2000, 2002, 2005, 2007 phpBB Group.