2 File : $Source: /cvsroot/ijbswa/current/doc/source/changelog.sgml,v $
4 Purpose : Entity included in other project documents.
6 $Id: changelog.sgml,v 2.2 2013/02/27 16:49:20 fabiankeil Exp $
8 Copyright (C) 2013 Privoxy Developers http://www.privoxy.org/
11 ======================================================================
12 This file used for inclusion with other documents only.
13 ======================================================================
15 If you make changes to this file, please verify the finished
16 docs all display as intended.
18 This file is included into:
24 <application>Privoxy 3.0.21</application> stable is a bug-fix release
25 for Privoxy 3.0.20 beta. It also addresses a security issue that affects
26 all previous Privoxy versions (on some platforms). The changes since
31 The SGML ChangeLog can be generated with: utils/changelog2doc.pl ChangeLog
41 On POSIX-like platforms, network sockets with file descriptor
42 values above FD_SETSIZE are properly rejected. Previously they
43 could cause memory corruption in configurations that allowed
44 the limit to be reached.
49 Compiles on OS/2 again now that unistd.h is only included
50 on platforms that have it.
62 The show-status page shows the FEATURE_STRPTIME_SANITY_CHECKS status.
67 A couple of assert()s that could theoretically dereference
68 NULL pointers in debug builds have been relocated.
73 Added an LSB info block to the generic start script.
74 Based on a patch from Natxo Asenjo.
79 The max-client-connections default has been changed to 128
80 which should be more than enough for most setups.
88 Action file improvements:
92 Block rover.ebay./ar.*\&adtype= instead of "/.*\&adtype=" which
93 caused too man false positives.
94 Reported by u302320 in #360284, additional feedback from Adam Piggott.
99 Unblock '.advrider.com/' and '/.*ADVrider'.
100 Anonymously reported in #3603636.
108 Filter file improvements:
112 Added an iframes filter.
120 Documentation improvements:
124 The whole GPLv2 text is included in the user manual now,
125 so Privoxy can serve it itself and the user can read it
126 without having to wade through GPLv3 ads first.
131 Properly numbered and underlined a couple of section titles
132 in the config that where previously overlooked due to a flaw
133 in the conversion script. Reported by Ralf Jungblut.
138 Improved the support instruction to hopefully make it harder to
139 unintentionally provide insufficient information when requesting
140 support. Previously it wasn't obvious that the information we need
141 in bug reports is usually also required in support requests.
146 Removed documentation about packages that haven't been provided
155 Privoxy-Regression-Test:
159 Only log the test number when not running in verbose mode
160 The position of the test is rarely relevant and it previously
161 wasn't exactly obvious which one of the numbers was useful to
162 repeat the test with --test-number.
170 GNUmakefile improvements:
174 Factor generate-config-file out of config-file to make testing
180 The clean target now also takes care of patch leftovers.
190 <application>Privoxy 3.0.20</application> beta contained the
191 following changes compared to the previous stable release:
202 Client sockets are now properly shutdown and drained before being
203 closed. This fixes page truncation issues with clients that aggressively
204 pipeline data on platforms that otherwise discard already written data.
205 The issue mainly affected Opera users and was initially reported
206 by Kevin in #3464439, szotsaki provided additional information to track
212 Fix latency calculation for shared connections (disabled by default).
213 It was broken since their introduction in 2009. The calculated latency
214 for most connections would be 0 in which case the timeout detection
215 failed to account for the real latency.
220 Reject URLs with invalid port. Previously they were parsed incorrectly and
221 characters between the port number and the first slash were silently
222 dropped as shown by curl test 187.
227 The default-server-timeout and socket-timeout directives accept 0 as
233 Fix a race condition on Windows that could cause Privoxy to become
234 unresponsive after toggling it on or off through the taskbar icon.
235 Reported by Tim H. in #3525694.
240 Fix the compilation on Windows when configured without IPv6 support.
245 Fix an assertion that could cause debug builds to abort() in case of
246 socks5 connection failures with "debug 2" enabled.
251 Fix an assertion that could cause debug builds to abort() if a filter
252 contained nul bytes in the replacement text.
260 General improvements:
264 Significantly improved keep-alive support for both client and server
270 New debug log level 65536 which logs all actions that were applied to
276 New directive client-header-order to forward client headers in a
277 different order than the one in which they arrived.
282 New directive tolerate-pipelining to allow client-side pipelining.
283 If enabled (3.0.20 beta enables it by default), Privoxy will keep
284 pipelined client requests around to deal with them once the current
285 request has been served.
290 New --config-test option to let Privoxy exit after checking whether or not
291 the configuration seems valid. The limitations noted in TODO #22 and #23
292 still apply. Based on a patch by Ramkumar Chinchani.
297 New limit-cookie-lifetime{} action to let cookies expire before the end
298 of the session. Suggested by Rick Sykes in #1049575.
303 Increase the hard-coded maximum number of actions and filter files from
304 10 to 30 (each). It doesn't significantly affect Privoxy's memory usage
305 and recompiling wasn't an option for all Privoxy users that reached the
311 Add support for chunk-encoded client request bodies. Previously
312 chunk-encoded request bodies weren't guaranteed to be forwarded correctly,
313 so this can also be considered a bug fix although chunk-encoded request
314 bodies aren't commonly used in the real world.
319 Add support for Tor's optimistic-data SOCKS extension, which can reduce the
320 latency for requests on newly created connections. Currently only the
321 headers are sent optimistically and only if the client request has already
322 been read completely which rules out requests with large bodies.
327 After preventing the client from pipelining, don't signal keep-alive
328 intentions. When looking at the response headers alone, it previously
329 wasn't obvious from the client's perspective that no additional responses
335 Stop considering client sockets tainted after receiving a request with body.
336 It hasn't been necessary for a while now and unnecessarily causes test
337 failures when using curl's test suite.
342 Allow HTTP/1.0 clients to signal interest in keep-alive through the
343 Proxy-Connection header. While such client are rare in the real world, it
344 doesn't hurt and couple of curl tests rely on it.
349 Only remove duplicated Content-Type headers when filters are enabled.
350 If they are not it doesn't cause ill effects and the user might not want it.
351 Downgrade the removal message to LOG_LEVEL_HEADER to clarify that it's not
352 an error in Privoxy and is unlikely to cause any problems in general.
353 Anonymously reported in #3599335.
358 Set the socket option SO_LINGER for the client socket.
363 Move several variable declarations to the beginning of their code block.
364 It's required when compiling with gcc 2.95 which is still used on some
365 platforms. Initial patch submitted by Simon South in #3564815.
370 Optionally try to sanity-check strptime() results before trusting them.
371 Broken strptime() implementations have caused problems in the past and
372 the most recent offender seems to be FreeBSD's libc (standards/173421).
377 When filtering is enabled, let Range headers pass if the range starts at
378 the beginning. This should work around (or at least reduce) the video
379 playback issues with various Apple clients as reported by Duc in #3426305.
384 Do not confuse a client hanging up with a connection time out. If a client
385 closes its side of the connection without sending a request line, do not
386 send the CLIENT_CONNECTION_TIMEOUT_RESPONSE, but report the condition
392 Allow closing curly braces as part of action values as long as they are
398 On Windows, the logfile is now written before showing the GUI error
399 message which blocks until the user acknowledges it.
400 Reported by Adriaan in #3593603.
405 Remove an unreasonable parameter limit in the CGI interface. The new
406 parameter limit depends on the memory available and is currently unlikely
407 to be reachable, due to other limits in both Privoxy and common clients.
408 Reported by Andrew on ijbswa-users@.
413 Decrease the chances of parse failures after requests with unsupported
414 methods were sent to the CGI interface.
422 Action file improvements:
426 Remove the comment that indicated that updated default.action versions
427 are released on their own.
432 Block 'optimize.indieclick.com/' and 'optimized-by.rubiconproject.com/'
437 Unblock 'adjamblog.wordpress.com/' and 'adjamblog.files.wordpress.com/'.
438 Reported by Ryan Farmer in #3496116.
443 Unblock '/.*Bugtracker'. Reported by pwhk in #3522341.
448 Add test URLs for '.freebsd.org' and '.watson.org'.
453 Unblock '.urbandictionary.com/popular'.
463 Block 'farm.plista.com/widgetdata.php'.
468 Block 'rotation.linuxnewmedia.com/'.
473 Block 'reklamy.sfd.pl/'. Reported by kacperdominik in #3399948.
478 Block 'g.adspeed.net/'.
483 Unblock 'websupport.wdc.com/'. Reported by Adam Piggot in #3577851.
488 Block '/openx/www/delivery/'.
493 Disable fast-redirects for '.googleapis.com/'.
498 Block 'imp.double.net/'. Reported by David Bo in #3070411.
503 Block 'gm-link.com/' which is used for email tracking.
504 Reported by David Bo in #1812733.
509 Verify that requests to "bwp." are blocked. URL taken from #1736879
510 submitted by Francois Marier.
515 Block '/.*bannerid='. Reported by Adam Piggott in #2975779.
520 Block 'cltomedia.info/delivery/' and '.adexprt.com/'.
521 Anonymously reported in #2965254.
526 Block 'de17a.com/'. Reported by David Bo in #3061472.
531 Block 'oskar.tradera.com/'. Reported by David Bo in #3060596.
536 Block '/scripts/webtrends\.js'. Reported by johnd16 in #3002729.
541 Block requests for 'pool.*.adhese.com/'. Reported by johnd16 in #3002716.
546 Update path pattern for Coremetrics and add tests.
547 Pattern and URLs submitted by Adam Piggott #3168443.
552 Enable +fast-redirects{check-decoded-url} for 'tr.anp.se/'.
553 Reported by David Bo in #3268832.
558 Unblock '.conrad.se/newsletter/banners/'. Reported by David Bo in #3413824.
563 Block '.tynt.com/'. Reported by Dan Stahlke in #3421767.
568 Unblock '.bbci.co.uk/radio/'. Reported by Adam Piggott in #3569603.
573 Block requests to 'service.maxymiser.net/'.
574 Reported by johnd16 in #3118401 (with a previous URL).
579 Disable fast-redirects for Google's "let's pretend your computer is
585 Unblock '/.*download' to resolve actionsfile feedback #3498129.
586 Submitted by Steven Kolins (soundcloud.com not working).
591 Unblock '.wlxrs.com/' which is required by hotmail.com.
592 Fixes #3413827 submitted by David Bo.
597 Add two unblock patterns for popup radio and TV players.
598 Submitted by Adam Piggott in #3596089.
606 Filter file improvements & bug fixes:
610 Add a referer tagger.
615 Reduce the likelihood that the google filter messes up HTML-generating
616 JavaScript. Reported by Zeno Kugy in #3520260.
624 Documentation improvements:
628 Revised all OS X sections due to new packaging module (OSXPackageBuilder).
633 Update the list of supported operating systems to clarify that all Windows
634 versions after 95 are expected to work and note that the platform-specific
635 code for AmigaOS and QNX currently isn't maintained.
640 Update 'Signals' section, the only explicitly handled signals are SIGINT,
646 Add Haiku to the list of operating systems on which Privoxy is known to
652 Add DragonFly to the list of BSDs on which Privoxy is known to run.
657 Removed references to redhat-specific documentation set since it no longer
663 Removed references to building PDFs since we no longer do so.
668 Multiple listen-address directives are supported since 3.0.18, correct the
669 documentation to say so.
674 Remove bogus section about long and short being preferable to int.
679 Corrected some Internet JunkBuster references to Privoxy.
684 Removed references to www.junkbusters.com since it is no longer
685 maintained. Reported by Angelina Matson.
690 Various grammar and spelling corrections
695 Add a client-header-tagger{} example for disabling filtering for range
701 Correct a URL in the "Privoxy with Tor" FAQ.
706 Spell 'refresh-tags' correctly. Reported by Don in #3571927.
711 Sort manpage options alphabetically.
716 Remove an incorrect sentence in the toggle section. The toggle state
717 doesn't affect whether or not the Windows version uses the tray icon.
718 Reported by Zeno Kugy in #3596395.
723 Add new contributors since 3.0.19.
731 Log message improvements:
735 When stopping to watch a client socket due to pipelining, additionally log
741 Log the client socket and its condition before closing it. This makes it
742 more obvious that the socket actually gets closed and should help when
743 diagnosing problems like #3464439.
748 In case of SOCKS5 failures, do not explicitly log the server's response.
749 It hasn't helped so far and the response can already be logged by enabling
750 "debug 32768" anyway. This reverts v1.81 and the follow-up bug fix v1.84.
755 Relocate the connection-accepted message from listen_loop() to serve().
756 This way it's printed by the thread that is actually serving the
757 connection which is nice when grepping for thread ids in log files.
769 Remove compatibility layer for versions prior to 3.0 since it has been
770 obsolete for more than 10 years now.
775 Remove the ijb_isupper() and ijb_tolower() macros from parsers.c since
776 they aren't used in this file.
781 Removed the 'Functions declared include:' comment sections since they tend
782 to be incomplete, incorrect and out of date and the benefit seems
788 Various comment grammar and comprehensibility improvements.
793 Remove a pointless fflush() call in chat(). Flushing all streams pretty
794 much all the time for no obvious reason is ridiculous.
799 Relocate ijb_isupper()'s definition to project.h and get the ijb_tolower()
800 definition from there, too.
805 Relocate ijb_isdigit()'s definition to project.h.
810 Rename ijb_foo macros to privoxy_foo.
815 Add malloc_or_die() which will allow to simplify code paths where malloc()
816 failures don't need to be handled gracefully.
821 Add strdup_or_die() which will allow to simplify code paths where strdup()
822 failures don't need to be handled gracefully.
827 Replace strdup() calls with strdup_or_die() calls where it's safe and
833 Fix white-space around parentheses.
838 Add missing white-space behind if's and the following parentheses.
843 Unwrap a memcpy() call in resolve_hostname_to_ip().
848 Declare pcrs_get_delimiter()'s delimiters[] static const.
853 Various optimisations to remove dead code and merge inefficient code
854 structures for improved clarity, performance or code compactness.
859 Various data type corrections.
864 Change visibility of several code segments when compiling without
865 FEATURE_CONNECTION_KEEP_ALIVE enabled for clarity.
870 In pcrs_get_delimiter(), do not use delimiters outside the ASCII range.
871 Fixes a clang complaint.
876 Fix an error message in get_last_url() nobody is supposed to see.
877 Reported by Matthew Fischer in #3507301.
882 Fix a typo in the no-zlib-support complaint. Patch submitted by Matthew
888 Shorten ssplit()'s prototype by removing the last two arguments. We always
889 want to skip empty fields and ignore leading delimiters, so having
890 parameters for this only complicates the API.
895 Use an enum for the type of the action value.
900 Rename action_name's member takes_value to value_type as it isn't used as
906 Turn family mismatches in match_sockaddr() into fatal errors.
911 Let enlist_unique_header() verify that the caller didn't pass a header
912 containing either \r or \n.
917 Change the hashes used in load_config() to unsigned int. That's what
918 hash_string() actually returns and using a potentially larger type
924 Use privoxy_tolower() instead of vanilla tolower() with manual casting of
930 Catch ssplit() failures in parse_cgi_parameters().
938 Privoxy-Regression-Test:
942 Add an 'Overwrite condition' directive to skip any matching tests before
943 it. As it has a global scope, using it is more convenient than clowning
944 around with the Ignore directive.
949 Log to STDOUT instead of STDERR.
954 Include the Privoxy version in the output.
959 Various grammar and spelling corrections in documentation and code.
964 Additional tests for range requests with filtering enabled.
969 Tests with mostly invalid range request.
974 Add a couple of hide-if-modified-since{} tests with different date formats.
979 Cleaned up the format of the regression-tests.action file to match the
980 format of default.action.
985 Remove the "Copyright" line from print_version(). When using --help, every
986 line of screen space matters and thus shouldn't be wasted on things the
987 user doesn't care about.
999 Improve the --statistics performance by skipping sanity checks for input
1000 that shouldn't affect the results anyway. Add a --strict-checks option
1001 that enables some of the checks again, just in case anybody cares.
1006 The distribution of client requests per connection is included in
1007 the --statistic output.
1012 The --accept-unknown-messages option has been removed and the behavior
1018 Accept and (mostly) highlight new log messages introduced with
1031 Bump generated Firefox version to 17.
1039 GNUmakefile improvements:
1043 The dok-tidy target no longer taints documents with a tidy-mark
1048 Change RA_MODE from 0664 to 0644. Suggested by Markus Dittrich in
1054 Remove tidy's clean flag as it changes the scope of attributes.
1055 Link-specific colors end up being applied to all text. Reported by Adam
1056 Piggott in #3569551.
1061 Leave it up to the user whether or not smart tags are inserted.
1066 Let w3m itself do the line wrapping for the config file. It works better
1067 than fmt as it can honour pre tags causing less unintentional line breaks.
1072 Ditch a pointless '-r' passed to rm to delete files.
1077 The config-file target now requires less manual intervention and updates
1078 the original config.
1083 Change WDUMP to generate ASCII. Add WDUMP_UTF8 to allow UTF-8 in the
1084 AUTHORS file so the names are right.
1089 Stop pretending that lynx and links are supported for the documentation.
1097 configure improvements:
1101 On Haiku, do not pass -lpthread to the compiler. Haiku's pthreads
1102 implementation is contained in its system library, libroot, so no
1103 additional library needs to be searched.
1104 Patch submitted by Simon South in #3564815.
1109 Additional Haiku-specific improvements. Disable checks intended for
1110 multi-user systems as Haiku is presently single-user. Group Haiku-specific
1111 settings in their own section, following the pattern for Solaris, OS/2 and
1112 AmigaOS. Add additional library-related settings to remove the need for
1113 providing configure with custom LDFLAGS.
1114 Submitted by Simon South in #3574538.