X-Git-Url: http://www.privoxy.org/gitweb/?a=blobdiff_plain;f=doc%2Fsource%2Fdeveloper-manual.sgml;h=e17e675cb9f781eaae8e6c1c3a27b38551253c15;hb=8566fa5928990558ee7fb10b2fb662ac3d20fb90;hp=deab4bd200c25c18563e10f37ba31b5dbff7d92e;hpb=7fa217da5b2f8777fd6287bf29a46b9815106787;p=privoxy.git diff --git a/doc/source/developer-manual.sgml b/doc/source/developer-manual.sgml index deab4bd2..e17e675c 100644 --- a/doc/source/developer-manual.sgml +++ b/doc/source/developer-manual.sgml @@ -5,7 +5,7 @@ - + @@ -19,7 +19,7 @@ Purpose : developer manual - Copyright (C) 2001-2020 Privoxy Developers https://www.privoxy.org/ + Copyright (C) 2001-2023 Privoxy Developers https://www.privoxy.org/ See LICENSE. ======================================================================== @@ -39,7 +39,7 @@ Copyright - &my-copy; 2001-2020 by + &my-copy; 2001-2023 by Privoxy Developers @@ -390,7 +390,7 @@ Successfully rebased and updated refs/heads/local-branch. course this, the developer-manual in this format. The README, AUTHORS, INSTALL, - privoxy.1 (man page), and + privoxy.8 (man page), and config files are also now maintained as Docbook SGML. These files, when built, in the top-level source directory are generated files! Also, the Privoxy index.html (and a @@ -2057,7 +2057,7 @@ fk@t520 ~ $privoxy-regression-test.pl --test-number 785 --verbose --debug 4 2020-12-14 12:17:56: Ooops. Expected removal but: 'Referer: https://p.p/' is still there. 2020-12-14 12:17:56: Failure for test 785 (0/13/5). Header 'Referer: https://p.p/' and tag 'hide-referrer{conditional-block}' 2020-12-14 12:17:56: Executed 1 regression tests. Skipped 1201. 0 successes, 1 failures. - + Use the if the --privoxy-address option if the http_proxy environment variable isn't configured and you don't want @@ -2257,7 +2257,7 @@ $ afl-fuzz -i input/ -o output/ -f bla.filter -m none privoxy --fuzz filter bla. - Update the code status (CODE_STATUS="xxx") in configure.in to one of + Update the code status (CODE_STATUS="xxx") in configure.in to one of "alpha", "beta" or "stable". @@ -2280,7 +2280,7 @@ $ ./configure # rebuild GNUmakefile If action file processing has changed and is not backward-compatible, make sure the "for-privoxy-version=x.y.z" minimum version number in - default.action.master has been updated: + default.action.master has been updated: {{settings}} @@ -2294,12 +2294,12 @@ for-privoxy-version=3.0.11 Create the change log: - $ git tag - # to see the tags - $ git log [last release tag]..master > /tmp/log - # get the commit log since the last release - $ utils/makeChangeLog /tmp/log > /tmp/change.log - # reformat the commit log +$ git tag +# to see the tags +$ git log [last release tag]..master > /tmp/log +# get the commit log since the last release +$ utils/makeChangeLog /tmp/log > /tmp/change.log +# reformat the commit log Edit /tmp/change.log to remove trivial @@ -2322,7 +2322,7 @@ for-privoxy-version=3.0.11 doc/source/changelog.sgml: - $ utils/changelog2doc.pl /tmp/change.log >| doc/source/changelog.sgml +$ utils/changelog2doc.pl /tmp/change.log >| doc/source/changelog.sgml @@ -2331,15 +2331,20 @@ for-privoxy-version=3.0.11 make sure noteworthy changes are referenced. + + + Update the announcement at doc/webserver/announce.txt. + + All documentation should be rebuilt: - $ make man - $ make dok - $ make dok-man - $ make dok-tidy - $ make config-file +$ make man +$ make dok +$ make dok-man +$ make dok-tidy +$ make config-file Finished docs should be then be committed to Git (for those without the ability to build these). Some docs may require @@ -2378,6 +2383,12 @@ for-privoxy-version=3.0.11 Don't use vX_Y_Z, ver_X_Y_Z, v_X.Y.Z (won't work) etc. + + + Push the tag to the remote with + git push origin v_X_Y_Z. + + On the webserver, copy the user manual to a new top-level directory @@ -2406,11 +2417,11 @@ for-privoxy-version=3.0.11 - mkdir dist # delete or choose different name if it already exists - cd dist - git clone https://www.privoxy.org/git/privoxy.git - cd privoxy - git checkout v_X_Y_Z +mkdir dist # delete or choose different name if it already exists +cd dist +git clone https://www.privoxy.org/git/privoxy.git +cd privoxy +git checkout v_X_Y_Z @@ -2560,13 +2571,13 @@ for-privoxy-version=3.0.11 packages" above). Then run from that directory: - autoheader && autoconf && ./configure +autoheader && autoconf && ./configure Then do: - make tarball-dist +make tarball-dist @@ -2585,17 +2596,32 @@ for-privoxy-version=3.0.11 First, make sure that you have freshly exported the right version into an empty directory. (See "Building and releasing packages" above). - + + + Check that you have the current versions of the + + NSIS installer, + PCRE library, + MBED TLS library, + + Brotli library, + and that the MAKENSIS evar in + windows/GNUMakefile + points to the NSIS installer program. (See the + + Building from Source / Windows + section of the User Manual for details.) + + Then you can build the package. This is fully automated, and is controlled by windows/GNUmakefile. All you need to do is: - cd windows - make +cd windows +make Now you can manually rename privoxy_setup.exe to @@ -2605,8 +2631,8 @@ for-privoxy-version=3.0.11 GPG sign the installer and zip file, - $ gpg --armor --detach --sign privoxy_setup_X.Y.Z.exe - $ gpg --armor --detach --sign privoxy_X.Y.Z.zip +gpg --armor --detach --sign privoxy_setup_X.Y.Z.exe +gpg --armor --detach --sign privoxy_X.Y.Z.zip and upload the files to SourceForge. @@ -2620,126 +2646,199 @@ for-privoxy-version=3.0.11 Debian - First, make sure that you have freshly exported the - right version into an empty directory. (See - "Building and releasing packages" above). Then add a log - entry to debian/changelog, if it is not - already there, for example by running (from the debian directory): + Using git-buildpackage we start with a clone of the last Debian version: - - debchange -v &p-version;-&p-status;-1 "New upstream version" + +gbp clone https://salsa.debian.org/debian/privoxy.git +cd privoxy - Then, run (from the root directory): + or if the repository is already there - - dpkg-buildpackage -rfakeroot -us -uc -b + +cd privoxy +gbp pull - This will create - ../privoxy_&p-version;-&p-status;-1_i386.deb - which can be uploaded. + Now import the newly released upstream tarball via debian/watch file: + + +gbp import-orig --uscan + + + Next update all Debian quilt patches to the new version: + + +while quilt push; do quilt refresh; done + + + If some patch is no longer required (because it is already merged + upstream), it can be removed using + + +quilt delete XX_patchname.patch +git rm debian/patches/XX_patchname.patch + + + If the patch needs modification, you can apply, edit and update it with + + +quilt push -f +quilt edit some_file +quilt refresh + + + until + + +while quilt push; do quilt refresh; done + + + succeeds. Then you can + + +quilt pop -a + + + Now add a new entry to the debian/changelog representing the new + version: + + +dch -v &p-version;-1 + + + and describe what you did before and don't forget to git commit all + changes. + + + Now you can build the package on the local machine using + + +gbp buildpackage -us -uc + + + You should check for warnings using + + +lintian -iI ../build-area/privoxy_&p-version;-1_amd64.changes + + + Maybe rebuild the package in different defined cowbuilder environments + like + + +sudo cowbuilder --build --basepath /var/cache/pbuilder/base.cow ../build-area/privoxy_&p-version;-1.dsc + + + And try to run autopackage testing suite on the result: + + +autopkgtest /var/cache/pbuilder/result/privoxy_&p-version;-1_amd64.changes -s -- schroot sid + + + Or just push the changes to salsa.debian.org, where a CI pipeline is + defined for the package, that builds and tests it. + + + If everything is okay, run cowbuilder with i386 and amd64 environments + for current Debian stable release and build + privoxy_&p-version;-1_i386.deb and privoxy_&p-version;-1_amd64.deb. + Then sign both files: + + +gpg --detach-sign --armor privoxy_&p-version;-1_i386.deb +gpg --detach-sign --armor privoxy_&p-version;-1_amd64.deb + + + Create a README file containing the recent block from debian/changelog + and upload the two packages, the two signatures and the README to a + freshly created folder below + https://sourceforge.net/projects/ijbswa/files/Debian/ - - Mac OS X + Debian GIT Snapshot - First, make sure that you have freshly exported the right - version into an empty directory. (See "Building and releasing - packages" above). + For building just a git snapshot build the following workflow may be + useful. First create a build environment, for this you may have to + run the following commands: + +sudo apt install build-essential devscripts +sudo apt-get build-dep privoxy + - There are three modules available in the CVS repository backups for use on Mac - OS X, though technically only two of them generate a release (the other - can be used to install from source). + After this enter the checked out privoxy git tree and check that all + (new) build dependencies are met: - - OSXPackageBuilder module (Documentation out of date) - - The OSXPackageBuilder module generates OS X installer packages - supporting all Macs running OS X 10.4 and above. Obtain it from CVS as - follows into a folder parallel to the exported privoxy source: - - - cvs -z3 -d:pserver:anonymous@ijbswa.cvs.sourceforge.net:/cvsroot/ijbswa co OSXPackageBuilder + +dpkg-checkbuilddeps - - The module contains complete instructions on its usage in the file - OS X Package Builder HOWTO.txt. - - - Once the package(s) have been generated, you can then upload them - directly to the Files section of the Sourceforge project in the - Macintosh (OS X) folder. Each new version release of Privoxy should - have a new subfolder created in which to store its files. Please - ensure that the folder contains a readme file that makes it clear - which package is for whichversion of OS X. - - - - osxsetup module (DEPRECATED) (Documentation out of date) - - This module is deprecated since the installer it generates - places all Privoxy files in one folder in a non-standard location, and - supports only Intel Macs running OS X 10.6 or higher. - - - Check out the module from CVS as follows into a folder parallel to the - exported privoxy source: - - - cvs -z3 -d:pserver:anonymous@ijbswa.cvs.sourceforge.net:/cvsroot/ijbswa co osxsetup + + If something is missing, just add it using + + +sudo apt install foobar - - Then run: - - - cd osxsetup - build + + Now you may update debian/changelog, especially the version number + using + + +dch - - This will run autoheader, autoconf - and configure as well as make. - Finally, it will copy over the necessary files to the ./osxsetup/files - directory for further processing by PackageMaker. - - - Bring up PackageMaker with the PrivoxyPackage.pmsp definition file, - modify the package name to match the release, and hit the "Create - package" button. If you specify ./Privoxy.pkg as the output package - name, you can then create the distributable zip file with the command: - - - zip -r privoxyosx_setup_x.y.z.zip Privoxy.pkg + + and finally build the package: + + +debuild -us -uc -b - - You can then upload this file directly to the Files section of the - Sourceforge project in the Macintosh (OS X) folder. Each new version - release of Privoxy should have a new subfolder created in which to - store its files. - Please ensure that the folder contains a readme file that makes it - clear which version(s) of OS X the package supports. - - - - macsetup module (Documentation out of date) - - The macsetup module is ideal if you wish to build and install Privoxy - from source on a single machine. - - - Check out the module from CVS as follows into a folder parallel to the - exported privoxy source: - - - cvs -z3 -d:pserver:anonymous@ijbswa.cvs.sourceforge.net:/cvsroot/ijbswa co macsetup + + If everything went okay, you may find the resulting Debian package in + the parent directory. + + + You may want to clean up the build tree using + + +debian/rules clean - - The module contains complete instructions on its usage in its - README file. The end result will be the - exported version of Privoxy installed on the build machine. - - + + And maybe repair some artefacts using one or both of the following + commands: + + +git reset --hard +git clean -fd + + + + + macOS / OS X + + First, make sure that you have freshly exported the right + version into an empty directory. (See "Building and releasing + packages" above). + + + The OSXPackageBuilder module can generate OS X installer packages + supporting all Macs running OS X 10.4 and above. Obtain it from Git as + follows into a folder parallel to the exported privoxy source: + + +git clone ssh://git@git.privoxy.org:23/git/OSXPackageBuilder.git + + + The module contains complete instructions on its usage in the file + OS X Package Builder HOWTO.txt. + + + Once the package(s) have been generated, you can then upload them + directly to the Files section of the Sourceforge project in the + Macintosh (OS X) folder. Each new version release of Privoxy should + have a new subfolder created in which to store its files. Please + ensure that the folder contains a readme file that makes it clear + which package is for which version of OS X. + FreeBSD @@ -2778,6 +2877,31 @@ for-privoxy-version=3.0.11 + + Updating the RSS feed + + Once the packages are uploaded to SourceForge they should be + mirrored on the Privoxy websites + (https://www.privoxy.org/ + and + http://l3tczdiiwoo63iwxty4lhs6p7eaxop5micbn7vbliydgv63x5zrrrfyd.onion/). + This is usually done by Fabian who uses a couple of shell functions + for this that aren't documented or published yet. + + + Once the packages are uploaded to the mirror the RSS feed has to + be regenerated with a command like: + + + fk@t520 ~/git/privoxy $utils/create-package-feed.pl /tank/backups/sourceforge/frs/project/ijbswa/ doc/webserver/feeds/privoxy-releases.xm + + + The updated RSS feed then has to be uploaded to the SourceForge webserver + and mirrored on the Privoxy websites again. This, too, is usually done + by Fabian with undocumented and unpublished shell functions. + + + After the Release @@ -2837,7 +2961,7 @@ for-privoxy-version=3.0.11 SGML files, do: - make dok +make dok && make dok-tidy That will generate doc/webserver/user-manual, @@ -2862,7 +2986,7 @@ for-privoxy-version=3.0.11 If these are docs in the stable branch, then do: - make webserver +make webserver This will do the upload to the SourceForge webserver (which is manually