X-Git-Url: http://www.privoxy.org/gitweb/?a=blobdiff_plain;f=doc%2Fsource%2Fchangelog.sgml;h=7025d15588220c41d38e244551ed96bd0b20fc75;hb=3f9f7065e662a7c78f93d3f97ebe40452605976a;hp=c2812ba33e521455fbc48250031045570a9609a9;hpb=b89674c9ad76911e6e2cee92e772cbb073fe4e99;p=privoxy.git diff --git a/doc/source/changelog.sgml b/doc/source/changelog.sgml index c2812ba3..7025d155 100644 --- a/doc/source/changelog.sgml +++ b/doc/source/changelog.sgml @@ -1,11 +1,9 @@ - - Privoxy 3.0.21 stable is a bug-fix release - for Privoxy 3.0.20 beta. It addresses two security issues that - affect all previous Privoxy versions. The changes since 3.0.20 beta are: - + - - - - Bug fixes: - - - - On POSIX-like platforms, network sockets with file descriptor - values above FD_SETSIZE are properly rejected. Previously they - could cause memory corruption in configurations that allowed - the limit to be reached. - - - - - Proxy authentication headers are removed unless the new directive - enable-proxy-authentication-forwarding is used. Forwarding the - headers potentially allows malicious sites to trick the user - into providing them with login information. - Reported by Chris John Riley. - - - - - Compiles on OS/2 again now that unistd.h is only included - on platforms that have it. - - - - - - - - General improvements: - - - - The show-status page shows the FEATURE_STRPTIME_SANITY_CHECKS status. - - - - - A couple of assert()s that could theoretically dereference - NULL pointers in debug builds have been relocated. - - - - - Added an LSB info block to the generic start script. - Based on a patch from Natxo Asenjo. - - - - - The max-client-connections default has been changed to 128 - which should be more than enough for most setups. - - - - - - - - Action file improvements: - - - - Block rover.ebay./ar.*\&adtype= instead of "/.*\&adtype=" which - caused too man false positives. - Reported by u302320 in #360284, additional feedback from Adam Piggott. - - - - - Unblock '.advrider.com/' and '/.*ADVrider'. - Anonymously reported in #3603636. - - - - - Stop blocking '/js/slider\.js'. - Reported by Adam Piggott in #3606635 and _lvm in #2791160. - - - - - - - - Filter file improvements: - - - - Added an iframes filter. - - - - - - - - Documentation improvements: - - - - The whole GPLv2 text is included in the user manual now, - so Privoxy can serve it itself and the user can read it - without having to wade through GPLv3 ads first. - - - - - Properly numbered and underlined a couple of section titles - in the config that where previously overlooked due to a flaw - in the conversion script. Reported by Ralf Jungblut. - - - - - Improved the support instruction to hopefully make it harder to - unintentionally provide insufficient information when requesting - support. Previously it wasn't obvious that the information we need - in bug reports is usually also required in support requests. - - - - - Removed documentation about packages that haven't been provided - in years. - - - - - - - - Privoxy-Regression-Test: - - - - Only log the test number when not running in verbose mode - The position of the test is rarely relevant and it previously - wasn't exactly obvious which one of the numbers was useful to - repeat the test with --test-number. - - - - - - - - GNUmakefile improvements: - - - - Factor generate-config-file out of config-file to make testing - more convenient. - - - - - The clean target now also takes care of patch leftovers. - - - - - - + Privoxy 3.0.34 fixes a few + minor bugs and comes with a couple of general improvements + and new features. - - Privoxy 3.0.20 beta contained the - following changes compared to the previous stable release: + Changes in Privoxy 3.0.34 stable: - - + Bug fixes: - Client sockets are now properly shutdown and drained before being - closed. This fixes page truncation issues with clients that aggressively - pipeline data on platforms that otherwise discard already written data. - The issue mainly affected Opera users and was initially reported - by Kevin in #3464439, szotsaki provided additional information to track - down the cause. + Improve the handling of chunk-encoded responses by buffering the data + even if filters are disabled and properly keeping track of where the + various chunks are supposed to start and end. Previously Privoxy would + merely check the last bytes received to see if they looked like the + last-chunk. This failed to work if the last-chunk wasn't received in one + read and could also result in actual data being misdetected + as last-chunk. + Should fix: SF support request #1739. + Reported by: withoutname. - Fix latency calculation for shared connections (disabled by default). - It was broken since their introduction in 2009. The calculated latency - for most connections would be 0 in which case the timeout detection - failed to account for the real latency. + remove_chunked_transfer_coding(): Refuse to de-chunk invalid data + Previously the data could get corrupted even further. + Now we simply pass the unmodified data to the client. - Reject URLs with invalid port. Previously they were parsed incorrectly and - characters between the port number and the first slash were silently - dropped as shown by curl test 187. + gif_deanimate(): Tolerate multiple image extensions in a row. + This allows to deanimate all the gifs on: + https://commons.wikimedia.org/wiki/Category:Animated_smilies + Fixes SF bug #795 reported by Celejar. - The default-server-timeout and socket-timeout directives accept 0 as - valid value. + OpenSSL generate_host_certificate(): Use X509_get_subject_name() + instead of X509_get_issuer_name() to get the issuer for generated + website certificates so there are no warnings in the browser when using + an intermediate CA certificate instead of a self-signed root certificate. + Problem reported and patch submitted by Chakib Benziane. - Fix a race condition on Windows that could cause Privoxy to become - unresponsive after toggling it on or off through the taskbar icon. - Reported by Tim H. in #3525694. + can_filter_request_body(): Fix a log message that contained a spurious u. - Fix the compilation on Windows when configured without IPv6 support. + handle_established_connection(): Check for pending TLS data from the client + before checking if data is available on the connection. + The TLS library may have already consumed all the data from the client + response in which case poll() and select() will not detect that data is + available to be read. + Sponsored by: Robert Klemme. - Fix an assertion that could cause debug builds to abort() in case of - socks5 connection failures with "debug 2" enabled. + ssl_send_certificate_error(): Don't crash if there's no certificate + information available. This is only relevant when Privoxy is built with + wolfSSL 5.0.0 or later (code not yet published). Earlier wolfSSL versions + or the other TLS backends don't seem to trigger the crash. - Fix an assertion that could cause debug builds to abort() if a filter - contained nul bytes in the replacement text. + socks5_connect(): Add support for target hosts specified as IPv4 address + Previously the IP address was sent as domain. @@ -275,157 +112,74 @@ - Significantly improved keep-alive support for both client and server - connections. - - - - - New debug log level 65536 which logs all actions that were applied to - the request. - - - - - New directive client-header-order to forward client headers in a - different order than the one in which they arrived. - - - - - New directive tolerate-pipelining to allow client-side pipelining. - If enabled (3.0.20 beta enables it by default), Privoxy will keep - pipelined client requests around to deal with them once the current - request has been served. - - - - - New --config-test option to let Privoxy exit after checking whether or not - the configuration seems valid. The limitations noted in TODO #22 and #23 - still apply. Based on a patch by Ramkumar Chinchani. - - - - - New limit-cookie-lifetime{} action to let cookies expire before the end - of the session. Suggested by Rick Sykes in #1049575. - - - - - Increase the hard-coded maximum number of actions and filter files from - 10 to 30 (each). It doesn't significantly affect Privoxy's memory usage - and recompiling wasn't an option for all Privoxy users that reached the - limit. - - - - - Add support for chunk-encoded client request bodies. Previously - chunk-encoded request bodies weren't guaranteed to be forwarded correctly, - so this can also be considered a bug fix although chunk-encoded request - bodies aren't commonly used in the real world. + Add a client-body-tagger action which creates tags based on + the content of the request body. + Sponsored by: Robert Klemme. - Add support for Tor's optimistic-data SOCKS extension, which can reduce the - latency for requests on newly created connections. Currently only the - headers are sent optimistically and only if the client request has already - been read completely which rules out requests with large bodies. + When client-body filters are enabled, buffer the whole request + before opening a connection to the server. + Makes it less likely that the server connection times out + and we don't open a connection if the buffering fails anyway. + Sponsored by: Robert Klemme. - After preventing the client from pipelining, don't signal keep-alive - intentions. When looking at the response headers alone, it previously - wasn't obvious from the client's perspective that no additional responses - should be expected. + Add periods to a couple of log messages. - Stop considering client sockets tainted after receiving a request with body. - It hasn't been necessary for a while now and unnecessarily causes test - failures when using curl's test suite. + accept_connection(): Add missing space to a log message. - Allow HTTP/1.0 clients to signal interest in keep-alive through the - Proxy-Connection header. While such client are rare in the real world, it - doesn't hurt and couple of curl tests rely on it. + Initialize ca-related defaults with strdup_or_die() so errors + aren't silently ignored. - Only remove duplicated Content-Type headers when filters are enabled. - If they are not it doesn't cause ill effects and the user might not want it. - Downgrade the removal message to LOG_LEVEL_HEADER to clarify that it's not - an error in Privoxy and is unlikely to cause any problems in general. - Anonymously reported in #3599335. + make_path: Use malloc_or_die() in cases where allocation errors + were already fatal anyway. - Set the socket option SO_LINGER for the client socket. + handle_established_connection(): Improve an error message slightly. - Move several variable declarations to the beginning of their code block. - It's required when compiling with gcc 2.95 which is still used on some - platforms. Initial patch submitted by Simon South in #3564815. + receive_client_request(): Reject https URLs without CONNECT request. - Optionally try to sanity-check strptime() results before trusting them. - Broken strptime() implementations have caused problems in the past and - the most recent offender seems to be FreeBSD's libc (standards/173421). + Include all requests in the statistics if mutexes are available. + Previously in case of reused connections only the last request got + counted. The statistics still aren't perfect but it's an improvement. - When filtering is enabled, let Range headers pass if the range starts at - the beginning. This should work around (or at least reduce) the video - playback issues with various Apple clients as reported by Duc in #3426305. + Add read_socks_reply() and start using it in socks5_connect() + to apply the socket timeout more consistently. - Do not confuse a client hanging up with a connection time out. If a client - closes its side of the connection without sending a request line, do not - send the CLIENT_CONNECTION_TIMEOUT_RESPONSE, but report the condition - properly. + socks5_connect(): Deal with domain names in the socks reply - Allow closing curly braces as part of action values as long as they are - escaped. - - - - - On Windows, the logfile is now written before showing the GUI error - message which blocks until the user acknowledges it. - Reported by Adriaan in #3593603. - - - - - Remove an unreasonable parameter limit in the CGI interface. The new - parameter limit depends on the memory available and is currently unlikely - to be reachable, due to other limits in both Privoxy and common clients. - Reported by Andrew on ijbswa-users@. - - - - - Decrease the chances of parse failures after requests with unsupported - methods were sent to the CGI interface. + Add a filter for bundeswehr.de that hides the cookie and + privacy info banner. @@ -437,179 +191,89 @@ - Remove the comment that indicated that updated default.action versions - are released on their own. - - - - - Block 'optimize.indieclick.com/' and 'optimized-by.rubiconproject.com/' + Disable filter{banners-by-size} for .freiheitsfoo.de/. - Unblock 'adjamblog.wordpress.com/' and 'adjamblog.files.wordpress.com/'. - Reported by Ryan Farmer in #3496116. + Disable filter{banners-by-size} for freebsdfoundation.org/. - Unblock '/.*Bugtracker'. Reported by pwhk in #3522341. + Disable fast-redirects for consent.youtube.com/. - Add test URLs for '.freebsd.org' and '.watson.org'. + Block requests to ups.xplosion.de/. - Unblock '.urbandictionary.com/popular'. + Block requests for elsa.memoinsights.com/t. - Block '.adnxs.com/'. + Fix a typo in a test. - Block 'farm.plista.com/widgetdata.php'. + Disable fast-redirects for launchpad.net/. - Block 'rotation.linuxnewmedia.com/'. + Unblock .eff.org/. - Block 'reklamy.sfd.pl/'. Reported by kacperdominik in #3399948. + Stop unblocking .org/.*(image|banner) which appears to be too generous + The example URL http://www.gnu.org/graphics/gnu-head-banner.png is + already unblocked due to .gnu.org being unblocked. - Block 'g.adspeed.net/'. + Unblock adfd.org/. - Unblock 'websupport.wdc.com/'. Reported by Adam Piggot in #3577851. + Disable filter{banners-by-link} for .eff.org/. - Block '/openx/www/delivery/'. + Block requests to odb.outbrain.com/. - Disable fast-redirects for '.googleapis.com/'. + Disable fast-redirects for .gandi.net/. - Block 'imp.double.net/'. Reported by David Bo in #3070411. + Disable fast-redirects{} for .onion/.*/status/. - Block 'gm-link.com/' which is used for email tracking. - Reported by David Bo in #1812733. + Disable fast-redirects{} for twitter.com/.*/status/. - Verify that requests to "bwp." are blocked. URL taken from #1736879 - submitted by Francois Marier. + Unblock pinkstinks.de/. - Block '/.*bannerid='. Reported by Adam Piggott in #2975779. - - - - - Block 'cltomedia.info/delivery/' and '.adexprt.com/'. - Anonymously reported in #2965254. - - - - - Block 'de17a.com/'. Reported by David Bo in #3061472. - - - - - Block 'oskar.tradera.com/'. Reported by David Bo in #3060596. - - - - - Block '/scripts/webtrends\.js'. Reported by johnd16 in #3002729. - - - - - Block requests for 'pool.*.adhese.com/'. Reported by johnd16 in #3002716. - - - - - Update path pattern for Coremetrics and add tests. - Pattern and URLs submitted by Adam Piggott #3168443. - - - - - Enable +fast-redirects{check-decoded-url} for 'tr.anp.se/'. - Reported by David Bo in #3268832. - - - - - Unblock '.conrad.se/newsletter/banners/'. Reported by David Bo in #3413824. - - - - - Block '.tynt.com/'. Reported by Dan Stahlke in #3421767. - - - - - Unblock '.bbci.co.uk/radio/'. Reported by Adam Piggott in #3569603. - - - - - Block requests to 'service.maxymiser.net/'. - Reported by johnd16 in #3118401 (with a previous URL). - - - - - Disable fast-redirects for Google's "let's pretend your computer is - infected" page. - - - - - Unblock '/.*download' to resolve actionsfile feedback #3498129. - Submitted by Steven Kolins (soundcloud.com not working). - - - - - Unblock '.wlxrs.com/' which is required by hotmail.com. - Fixes #3413827 submitted by David Bo. - - - - - Add two unblock patterns for popup radio and TV players. - Submitted by Adam Piggott in #3596089. + Disable fast-redirects for .hagalil.com/. @@ -617,158 +281,25 @@ - Filter file improvements & bug fixes: - - - - Add a referer tagger. - - - - - Reduce the likelihood that the google filter messes up HTML-generating - JavaScript. Reported by Zeno Kugy in #3520260. - - - - - - - - Documentation improvements: - - - - Revised all OS X sections due to new packaging module (OSXPackageBuilder). - - - - - Update the list of supported operating systems to clarify that all Windows - versions after 95 are expected to work and note that the platform-specific - code for AmigaOS and QNX currently isn't maintained. - - - - - Update 'Signals' section, the only explicitly handled signals are SIGINT, - SIGTERM and SIGHUP. - - - - - Add Haiku to the list of operating systems on which Privoxy is known to - run. - - - - - Add DragonFly to the list of BSDs on which Privoxy is known to run. - - - - - Removed references to redhat-specific documentation set since it no longer - exists. - - - - - Removed references to building PDFs since we no longer do so. - - - - - Multiple listen-address directives are supported since 3.0.18, correct the - documentation to say so. - - - - - Remove bogus section about long and short being preferable to int. - - - - - Corrected some Internet JunkBuster references to Privoxy. - - - - - Removed references to www.junkbusters.com since it is no longer - maintained. Reported by Angelina Matson. - - - - - Various grammar and spelling corrections - - - - - Add a client-header-tagger{} example for disabling filtering for range - requests. - - - - - Correct a URL in the "Privoxy with Tor" FAQ. - - - - - Spell 'refresh-tags' correctly. Reported by Don in #3571927. - - - - - Sort manpage options alphabetically. - - - - - Remove an incorrect sentence in the toggle section. The toggle state - doesn't affect whether or not the Windows version uses the tray icon. - Reported by Zeno Kugy in #3596395. - - - - - Add new contributors since 3.0.19. - - - - - - - - Log message improvements: + Privoxy-Log-Parser: - When stopping to watch a client socket due to pipelining, additionally log - the socket number. - - - - - Log the client socket and its condition before closing it. This makes it - more obvious that the socket actually gets closed and should help when - diagnosing problems like #3464439. + Bump version to 0.9.5. - In case of SOCKS5 failures, do not explicitly log the server's response. - It hasn't helped so far and the response can already be logged by enabling - "debug 32768" anyway. This reverts v1.81 and the follow-up bug fix v1.84. + Highlight more log messages. - Relocate the connection-accepted message from listen_loop() to serve(). - This way it's printed by the thread that is actually serving the - connection which is nice when grepping for thread ids in log files. + Highlight the Crunch reason only once. Previously the "crunch reason" + could also be highlighted when the URL contained a matching string. + The real crunch reason only occurs once per line, so there's no need + to continue looking for it after it has been found once. + While at it, add a comment with an example log line. @@ -776,229 +307,48 @@ - Code cleanups: - - - - Remove compatibility layer for versions prior to 3.0 since it has been - obsolete for more than 10 years now. - - - - - Remove the ijb_isupper() and ijb_tolower() macros from parsers.c since - they aren't used in this file. - - - - - Removed the 'Functions declared include:' comment sections since they tend - to be incomplete, incorrect and out of date and the benefit seems - questionable. - - - - - Various comment grammar and comprehensibility improvements. - - - - - Remove a pointless fflush() call in chat(). Flushing all streams pretty - much all the time for no obvious reason is ridiculous. - - - - - Relocate ijb_isupper()'s definition to project.h and get the ijb_tolower() - definition from there, too. - - - - - Relocate ijb_isdigit()'s definition to project.h. - - - - - Rename ijb_foo macros to privoxy_foo. - - - - - Add malloc_or_die() which will allow to simplify code paths where malloc() - failures don't need to be handled gracefully. - - - - - Add strdup_or_die() which will allow to simplify code paths where strdup() - failures don't need to be handled gracefully. - - - - - Replace strdup() calls with strdup_or_die() calls where it's safe and - simplifies the code. - - - - - Fix white-space around parentheses. - - - - - Add missing white-space behind if's and the following parentheses. - - - - - Unwrap a memcpy() call in resolve_hostname_to_ip(). - - - - - Declare pcrs_get_delimiter()'s delimiters[] static const. - - - - - Various optimisations to remove dead code and merge inefficient code - structures for improved clarity, performance or code compactness. - - - - - Various data type corrections. - - - - - Change visibility of several code segments when compiling without - FEATURE_CONNECTION_KEEP_ALIVE enabled for clarity. - - - - - In pcrs_get_delimiter(), do not use delimiters outside the ASCII range. - Fixes a clang complaint. - - - - - Fix an error message in get_last_url() nobody is supposed to see. - Reported by Matthew Fischer in #3507301. - - - - - Fix a typo in the no-zlib-support complaint. Patch submitted by Matthew - Fischer in #3507304. - - - - - Shorten ssplit()'s prototype by removing the last two arguments. We always - want to skip empty fields and ignore leading delimiters, so having - parameters for this only complicates the API. - - - - - Use an enum for the type of the action value. - - - - - Rename action_name's member takes_value to value_type as it isn't used as - boolean. - - - - - Turn family mismatches in match_sockaddr() into fatal errors. - - - - - Let enlist_unique_header() verify that the caller didn't pass a header - containing either \r or \n. - - - - - Change the hashes used in load_config() to unsigned int. That's what - hash_string() actually returns and using a potentially larger type - is at best useless. - - - - - Use privoxy_tolower() instead of vanilla tolower() with manual casting of - the argument. - - - - - Catch ssplit() failures in parse_cgi_parameters(). - - - - - - - - Privoxy-Regression-Test: + uagen: - Add an 'Overwrite condition' directive to skip any matching tests before - it. As it has a global scope, using it is more convenient than clowning - around with the Ignore directive. + Bump version to 1.2.4. - Log to STDOUT instead of STDERR. + Update BROWSER_VERSION and BROWSER_REVISION to 102.0 + to match the User-Agent of the current Firefox ESR. - Include the Privoxy version in the output. + Explicitly document that changing the 'Gecko token' is suspicious. - Various grammar and spelling corrections in documentation and code. + Consistently use a lower-case 'c' as copyright symbol. - Additional tests for range requests with filtering enabled. + Bump copyright. - Tests with mostly invalid range request. + Add 'aarch64' as Linux architecture. - Add a couple of hide-if-modified-since{} tests with different date formats. + Add OpenBSD architecture 'arm64'. - Cleaned up the format of the regression-tests.action file to match the - format of default.action. - - - - - Remove the "Copyright" line from print_version(). When using --help, every - line of screen space matters and thus shouldn't be wasted on things the - user doesn't care about. + Stop using sparc64 as FreeBSD architecture. + It hasn't been supported for a while now. @@ -1006,31 +356,19 @@ - Privoxy-Log-Parser: + Build system: - Improve the --statistics performance by skipping sanity checks for input - that shouldn't affect the results anyway. Add a --strict-checks option - that enables some of the checks again, just in case anybody cares. - - - - - The distribution of client requests per connection is included in - the --statistic output. + Makefile: Add a 'dok' target that depends on the 'error' target + to show the "You are not using GNU make or did nor run configure" + message. - The --accept-unknown-messages option has been removed and the behavior - is now the default. - - - - - Accept and (mostly) highlight new log messages introduced with - Privoxy 3.0.20. + configure: Fix --with-msan option. + Also (probably) reported by Andrew Savchenko. @@ -1038,11 +376,12 @@ - uagen: + macOS build system: - Bump generated Firefox version to 17. + Enable HTTPS inspection when building the macOS binary + (using OpenSSL as TLS library). @@ -1050,82 +389,29 @@ - GNUmakefile improvements: + Documentation: - The dok-tidy target no longer taints documents with a tidy-mark - - - - - Change RA_MODE from 0664 to 0644. Suggested by Markus Dittrich in - #3505445. - - - - - Remove tidy's clean flag as it changes the scope of attributes. - Link-specific colors end up being applied to all text. Reported by Adam - Piggott in #3569551. - - - - - Leave it up to the user whether or not smart tags are inserted. - - - - - Let w3m itself do the line wrapping for the config file. It works better - than fmt as it can honour pre tags causing less unintentional line breaks. + Add OpenSSL to the list of libraries that may be licensed under the + Apache 2.0 license in which case the linked Privoxy binary has to be + distributed under the GPLv3 or later. - Ditch a pointless '-r' passed to rm to delete files. + config: Fix the documented ca-directory default value. + Reported by avoidr. - The config-file target now requires less manual intervention and updates - the original config. - - - - - Change WDUMP to generate ASCII. Add WDUMP_UTF8 to allow UTF-8 in the - AUTHORS file so the names are right. - - - - - Stop pretending that lynx and links are supported for the documentation. - - - - - - - - configure improvements: - - - - On Haiku, do not pass -lpthread to the compiler. Haiku's pthreads - implementation is contained in its system library, libroot, so no - additional library needs to be searched. - Patch submitted by Simon South in #3564815. + Rebuild developer-manual and tidy with 'HTML Tidy for FreeBSD version 5.8.0'. - Additional Haiku-specific improvements. Disable checks intended for - multi-user systems as Haiku is presently single-user. Group Haiku-specific - settings in their own section, following the pattern for Solaris, OS/2 and - AmigaOS. Add additional library-related settings to remove the need for - providing configure with custom LDFLAGS. - Submitted by Simon South in #3574538. + Update developer manual with new macOS packaging instructions.