WebCopy

Version 1.9.1.872 04 September 2023
Due to changes in how WebCopy determines whether or not to process a given URL there could be differences with how WebCopy 1.9 works against previous versions. Please report any inconsistencies to us!
Added
Added the ability to read cookies from an external file (#461) (User Manual)
Added the ability to read cookies from an external file (#462) (User Manual)
Test URL dialogue now allows configuring cookies
Added cookie, cookie-jar and discard-session-cookies command line parameters (User Manual)
Added support for the legacy compress (#472) and non-standard BZip2 (#473) content encodings (User Manual)
Changed
Documentation improvements (#400, #443, #461, #462, #482, untracked)
Test URL dialogue now uses load on demand for settings pages
401 challenges no longer display credential dialogues unless the authentication type is either Basic or Digest as no other values have been tested due to lack of resource
Updated mime database
Fixed
Posting a form did not set an appropriate content type (#437)
Custom headers were not applied when posting forms (#436)
If a URL was previously skipped but then included in future scans, the original skip reason could be retained
A blank error message was displayed for Brotli decompression errors (#447)
One-time project validation checks were ignoring the content encoding settings of the project (which by default is Gzip and Deflate) and were requesting content with Brotli compression (#446)
(省略されました)

Version 1.9.0.822 20 January 2022
Due to changes in how WebCopy determines whether or not to process a given URL there could be differences with how WebCopy 1.9 works against previous versions. Please report any inconsistencies to us!
Added
It is now possible to read additional URLs to scan from a text file [#281] (User Manual)
Added no-directories, max-redirect and header arguments (User Manual)
Added proxy, proxy-user and proxy-password arguments [#337] (User Manual)
Added input-file argument [#282] (User Manual)
Added Redirects To column to the results list
Added Local File column to the files list
Added Local File, Redirects To, Depth and Distance columns to links lists
List views now display a configuration menu when context clicking a column header
The GUI client now supports many of the same command line arguments as the CLI [#403] (User Manual)
Added a new validator to try and detect unsupported websites [#407]
Added new URL normalisation options for forcing HTTPS [#383] (User Manual)
Added new URL normalisation option for ignoring case [#202] (User Manual)
Changed
Setup will now install Microsoft .NET 4.8 if not present
Adding multiple URLs to scan is now easier using a free text field [#282]
Command line tools now report unknown parameters
(省略されました)

ProductsColor Palette EditorCopyToolsGif AnimatorJewel RushNBT EditorSitemap CreatorSlicrSpriterWebCopyDownloadsFilesSource CodeOpen SourceBlog.NET BlogProduct BlogForumsSupport
Version 1.8.3.768 01 April 2021
Added
Separate 32bit and 64bit setup files are now available
Fixed
WebCopy would not copy sites using an IP address rather than a DNS name
URL validation checks were running on the base domain and ignoring any deep linking
WebCopy wouldn't always strip empty path segments from URLs
PDF and RSS will no longer be downloaded when performing a site analysis
Improvements to several windows affected when running under custom DPI scaling modes
The minimum / maximum file size editor required values to be entered as bytes, despite the labelling requesting kibibytes [#387]
Sometimes WebCopy didn't shrink a path correctly to fit within file system limitations [#393]
Default documents should no longer be named index.htm.html
Changed
Reorganised columns in results list view to hopefully reduce confusion when URLs are skipped
Non-crawlable URLs that are skipped during an analyse are now recorded in the results list
Introducing 64bit builds
30 March 2021
Removal of support for Windows Vista, Windows 8 and early versions of Windows 10
(省略されました)

Version 1.8.2.744 03 January 2021
Fixed
Initial redirect check wasn't applying a user agent which caused some sites to reject the request
New Project Wizard wasn't displaying correctly
Expanded default contentfilters.json used by the New Project Wizard to cover
Setup now uses InnoSetup 6
The Test URL dialog has been split in two, so that the result content is always visible
Fixed a crash which occurred when opening the Website Size dialog and the linkmap was empty.
Fixed a crash which occurred when clicking pie slices in the Website Size dialog and filtering was enabled
Fixed a crash that occurred when submitting the remove missing links dialog for a project without a valid URI
Status bar now shows pending crawl requests.
Holding down Shift when clicking the Copy Website or Analyze buttons forces the download of all resources, skipping last modified checks
A basic Regular Expression Editor is available and can be accessed via the
Tools we use - 2020 edition
01 January 2021
Creating a custom single-axis scrolling control in WinForms
28 December 2020
kbd Markdig Plugin
21 December 2020
(省略されました)

Version 1.8.2.740 13 December 2020
Warning! WebCopy projects saved using 1.8 are not backwards-compatible with older versions of WebCopy
Fixed
It should now be easier to manually type https addresses into the URL field, without WebCopy trying to inject http after each character press (regression from 1.8.2)

Version 1.8.2.739 06 December 2020
Warning! WebCopy projects saved using 1.8 are not backwards-compatible with older versions of WebCopy
Changed
When crawling for the first time, if the user-entered URL redirects (for example http to https or to www), WebCopy will now prompt to use the final URL [#368]
Fixed
Changing the URL of an existing project caused further crawling to instantly fail if the domain of the new URL did not match the old [#367] (regression in 1.8.1)
Added a speculative fix for a hang when crawling a website with the experimental "use web browser" option enabled
The GUI client now correctly allows unescaped URLs to be entered
When using the "Use query string in local file names" option, WebCopy now correctly sanitises the query string
Fixed a crash that occurred when trying to empty the destination folder using the 64bit version of WebCopy
Removed
Aero glass effects used by Windows 7 have been removed [#366]
An introduction to using Windows Image Acquisition (WIA) via C#
06 November 2020
Simulating Bacterial Chemotaxis
02 November 2020

Version 1.8.1.725 17 October 2020
Warning! WebCopy projects saved using 1.8 are not backwards-compatible with older versions of WebCopy
Added
Link Checker GUI client now allows the checking of external links to be enabled or disabled
Link Checker GUI client now allows if URLs belonging to parent, sibling or sub domains should be checked
Added auto scroll option to Link Checker GUI client
Added progress indicator to Link Checker GUI client
Added new Use Recycle Bin option to project settings. If set and the Empty website folder before copy is also set, any deleted files will be moved to the Recycle Bin instead
The View Links dialog now allows the display of excluded URLs to be toggled
Added proper editor for defining web page language settings at the project level
Add application level setting for definition web page language settings
List exports now present a configuration dialogue for which columns to include the export [#275]
Changed
WebCopy will now prompt to continue if the Empty website folder before copy option is set and files are present in the destination
The Sitemap Extension will now start from the base domain if the project URL is deep and the Crawl Above Root flag is set
Updated mime-db to 1.44.0
The GUI now displays a proper progress indicator and status information when remapping local files
The CLI client now displays status information when remapping files
The Origin Report option for new projects now defaults to Single File rather than Embedded
(省略されました)

Version 1.8.0.652 12 April 2020
Warning! WebCopy projects saved using 1.8 are not compatible with older versions. If you use a nightly/beta version of 1.8 we strongly recommend you keep a backup of any project files saved using this version in case you wish to revert to an older version
Fixed
Fixed a crash which occurred if contentfilters.json was not present in %appdata%\Cyotek\WebCopy\1.0
Installing Mopidy and pHAT Beat on a Raspberry Pi
10 April 2020

Version 1.8.0.651 07 April 2020
Warning! WebCopy projects saved using 1.8 are not compatible with older versions. If you use a nightly/beta version of 1.8 we strongly recommend you keep a backup of any project files saved using this version in case you wish to revert to an older version
Added
Added additional options to proxy server configuration, allowing the use of system proxies and user defined bypass lists
The poster attribute of video elements is now detected
Fixed
Fixed a crash that could occur when verifying the initial path
The Internet Explorer DOM provider failed to process some pages if an attribute request failed with an DISP_E_TYPEMISMATCH error
The Limit Crawl Depth, Limit Distance from Root URL, Maximum Files, Maximum File Size and Minimum File Size options would be processed if they had previously been set even if subsequently disabled
Proxy settings dialog now does a better job of validating the address
Fixed a crash when clicking help links in stand alone tools
Fixed a crash which could occur when using the Select URI dialog
Speculative fix for a crash when painting list views
Speculative fix for a crash trying to capture a form
Speculative fix for a crash setting the same folder
If any users know how to reproduce any of the crashes which are marked as speculative, details would be welcome.
Version 1.8.0.638 Beta 28 February 2020
Warning! WebCopy projects saved using 1.8 are not compatible with older versions. If you use a nightly/beta version of 1.8 we strongly recommend you keep a backup of any project files saved using this version in case you wish to revert to an older version
Added
(省略されました)

Version 1.7.0.600 29 April 2019
Changed
URI properties dialog are now opened as non-modal windows if possible
Fixed
Quick Scan dialog temporary restricts maximum number of displayed pages to 200, resolving a crash that occur on sites with thousands of detected pages
Fixed an issue where WebCopy would always full download files above the copy root if the Download All Resources option was enabled
Fixed an issue where WebCopy wouldn't correctly exclude entries above the root if the Download All Resources option was enabled
Files over 2GB in size wouldn't be downloaded
After 2147483647 files had been downloaded, no further downloads would occur
Setup programs were only signed with SHA256, meaning Windows Vista couldn't read the signatures
Setup tried to install .NET 4.6.2, causing an installation failure on Windows Vista which only supports 4.6.0
Version 1.7.0.583 Beta 17 January 2019
Added
It is now possible to authenticate with a website using an embedded web browser prior to copying, allowing WebCopy to work with sites that have complex login procedures or multi-factor authentication [#333]
When copying a website with an SSL certificate, if the Ignore certificate errors option is not set, WebCopy will now display a dialog asking what to do [#329]
Added a new option to include the original extension when remapping files [#324]
Added a new option to include the query string in local filenames [#267]
Added new options for limiting downloads based on file size (minimum and maximum) and on the number of files downloaded
Added Last Modified column to various URL list views
(省略されました)

Version 1.6.0.559 02 November 2018
Fixed
No progress dialog was displayed when clicking the Copy or Scan buttons to the right of the URL field
WebCopy 1.7 - web browser authentication
31 October 2018