diffoscope (93ubuntu1) bionic; urgency=medium * Merge from Debian unstable. Remaining changes: - Drop build dependency on pdftk. - debian/rules: Disable diffoscope version check for bionic. -- Mattia Rizzolo Thu, 05 Apr 2018 20:17:19 +0200 diffoscope (93) unstable; urgency=medium * Only append the file formats if --help is passed, otherwise we spam #debian-devel-changes et al. (re. #893443) * doc/Makefile: Reinstate accidental version parsing change; my sed call was over-eager. -- Chris Lamb Thu, 29 Mar 2018 10:03:03 +0100 diffoscope (92ubuntu1) bionic; urgency=medium * Merge with Debian; remaining changes: - Drop build dependency on pdftk. - debian/rules: Disable diffoscope version check for bionic. -- Matthias Klose Tue, 27 Mar 2018 11:45:52 +0800 diffoscope (92) unstable; urgency=medium [ Chris Lamb ] * New features: - Show the list of supported file types in the manual and --help output. We can copy-paste this into the website, etc.. Thanks to Jonathan Dowland for the suggestion. (Closes: #893443) - Add support for comparing Gnumeric spreadsheets. (Closes: #893311) * Bug fixes: - Additionally extract the classes.dex file from .apk files; apktool does not do this by default which was preventing us from recursing into it to find differences. Thanks to Hans-Christoph Steiner for the report. (Closes: #890904) - Recursively reset the permissions of temporary directories prior to deletion to ensure that non-writable permissions such as 0555 are removed and do not cause a traceback. (Closes: #891363) - Support the case where the python3-xattr package is installed but python3-pyxattr is not. Based on an patch by Doug Freed; thanks! (Closes: #892240) - Update Java tests for openjdk-9. (Closes: #893183) * Output: - Print a nicer error message if you only specify one file to compare. - Don't show progress bar if we passed --debug as it just gets in the way. * Code tidying: - Avoid some necessary indentation around unconditional control flow. - Tidy unnecessary assignments. - Move the documentation for maybe_decode into a docstring on the method itself. - Import LooseVersion as LooseVersion. - Use more Pythonic `old_level` variable names (over `oldLabel`) and avoid using ambiguous `l` variable names. - Add whitespace around operators and ensure 4-line indentation throughout. * debian/*: - Move DOS/MBR check into the testsuite. - Add explicit runtime dependency on python3-distutils as it was dropped in src:python3.6 3.6.5~rc1-2. * Misc: - Clarify that the Reproducible Builds project is not just about Debian. - Drop executable bit on doc/Makefile. - Use our bin/diffoscope wrapper in manpage generation to ensure we are using the local version of diffoscope. [ Mattia Rizzolo ] * Update terminology used in docs about exclusion options. Thanks to Paul Wise for the idea. (Closes: #893324) * Don't try to decode a string in comparators.utils.file. (Closes: #891903) * Save a bunch of system calls by resetting tempfile permissions when we actually need to do it. -- Chris Lamb Thu, 22 Mar 2018 10:28:44 -0400 diffoscope (91ubuntu1) bionic; urgency=medium * Drop build dependency on pdftk. -- Matthias Klose Wed, 21 Mar 2018 10:57:34 +0800 diffoscope (91) unstable; urgency=medium [ Mattia Rizzolo ] * d/clean: Remove .cache/. * diff: Wrap long regular expression for improved readability. * comparators.json: Fix UnicodeDecodeError with a non-UTF8 locale. * d/copyright: Update for the new year. * d/control: Bump Standards-Version to 4.1.3, no changes needed. * tests/android: + Skip tests involving abootimg on BE archs (see #725729). [ Daniel Shahaf ] * diffoscope.diff: Document feeders. Closes: #863880 * Optimize the common case of feeders. Closes: #863879 [ Juliana Oliveira ] * {tempfiles, utils.archive}: catch possible FileNotFoundError. * comparators.java: add support for procyon-decompiler. Closes: #849386 * {command, feeders, diff}: replaces subprocess.Popen() by .run(). This is done in preparation for work on multiprocessing (#842837). + {command, zip, feeders}: replaces .wait by the new .returncode property. + comparators.utils.command: replaces .stderr_content by .stderr. * tests: + test_progress: fix test case for some broken versions of python-progressbar. Closes: #877726 + utils.tools: add support for modules on skip_unless* annotations. [ Chris Lamb ] * comparators: + utils/compare: - Show extended filesystem metadata even when directly comparing two files, not just when we specify two directories. Closes: #888402 + macho: - If the If the LLVM disassembler does not work, try the internal one. Closes: #886736 - Always strip the filename, not just when by itself. + json: - Do some cheap fuzzy parsing to detect JSON files not named .json. - Also match unicode JSON files. - Optionally compare JSONs with the jsondiff module. Closes: #888112 + directory: - Report differences in extended file attributes when comparing files. Closes: #888401 + xsb: - Add support for comparing XMLBeans binary schemas. + barkeley_db: - Add support for comparing Berkeley DB files. Closes: #890528 * Misc code cleaup. * tests: + comparators.test_elf: Return '0' if we can't parse the readelf version number. Closes: #886963 * debian: + Explicitly build-depend and recommend e2fsprogs. Closes: #887180 [ Ximin Luo ] * Partially revert the changes done for #888402 to maintain the current. behaviour of --exclude-directory-metadata. * Refactor how the configuration is loaded: + Move the defaults into a Config.reset() method. + reset() the configuration at the end of main(), to help the testsuite. -- Mattia Rizzolo Thu, 01 Mar 2018 13:40:48 +0100 diffoscope (90) unstable; urgency=medium [ Juliana Oliveira ] * tests: + comparators/test_rlib: Fix tests for llvm >= 5.0. Closes: #877727 + Skip some tests if 'xz' is not present. -- Mattia Rizzolo Tue, 26 Dec 2017 19:49:30 +0100 diffoscope (89) unstable; urgency=medium [ Mike Hommey ] * comparators: + elf: - Add fallbacks to elf code section disassembly. Closes: #879003 + utils/libarchive: - Extract libarchive members with the file extension. [ Ximin Luo ] * Auto-generate manpage using help2man, so it's no longer out-of-date. * difference: + Add a Difference.from_command_exc() to help distinguish excluded commands from commands returning an empty diff. * comparators: + utils/command: - Replace the feed_stdin() feeder into the simpler stdin() function, which provides (if needed) a simple file opject instead of a feeder. + utils/container: - Add a perform_fuzzy_matching() method (wrapping the already existing method) so that comparators can easily override it. + deb: - Loose matching for .deb archive members, so it's possible to e.g. compare deb with different control.tar.{gz,xz}. Closes: #881937 + elf: - Improve disassembly fallbacks with Difference.from_command_exc(). + png: - Cater for the feed_stdin() removal. + zip: - Run zipinfo on /dev/stdin instead of a variable path to avoid including the temporary file name in the output. Closes: #879011 - Cater for the feed_stdin() removal. * presenters/formats: + Allow non-text formats to output an empty diff. * debian/clean: + Remove the egg file when cleaning. [ Chris Lamb ] * comparators: + utils/file: - Handle case where a file to be "fuzzy" matched does not contain enough entropy despite being over 512 bytes. Closes: #882981 + android: - Add support for Android ROM boot.img introspection. Closes: #884557 + symlink: - Make cleanup of placeholders idempotent. [ Juliana Oliveira Rodrigues ] * tests: + utils/tools: - Add a skip_if_tool_version_is() function. + elf: - Skip some tests if readelf is version '2.29', where its behaviour was accidentally changed to exit with code 1 when it previously didn't. Closes: #877728 [ Holger Levsen ] * debian/control: Bump Standards-Version to 4.1.2. No changes required. [ Mattia Rizzolo ] * debian/control: Set Rules-Requires-Root: no. * Bump Debhelper compat version to 11. -- Mattia Rizzolo Mon, 25 Dec 2017 14:49:22 +0100 diffoscope (88) unstable; urgency=medium [ Holger Levsen ] * Bump standards version to 4.1.1, no changes needed. [ Mattia Rizzolo ] * tests/comparators: + dtb: compatibility with version 1.4.5. Closes: #880279 [ Chris Lamb ] * comparators: + binwalk: improve names in output of "internal" members. Closes: #877525 + Omit misleading "any of" prefix when only complaining about one module in ImportError messages. * Don't crash on malformed md5sums files. Closes: #877473 * tests/comparators: + ps: ps2ascii > 9.21 now varies on timezone, so skip this test for now. + dtby: only parse the version number, not any "-dirty" suffix. * debian/watch: use HTTPS URI. [ Ximin Luo ] * comparators: + utils/file: diff container metadata centrally. Closes: #797759 This fixes a last remaining bug in fuzzy-matching across containers. + Fix all the affected comparators after the above change. -- Mattia Rizzolo Sat, 04 Nov 2017 16:26:09 +0100 diffoscope (87) unstable; urgency=medium [ Juliana Oliveira Rodrigues ] * comparators: + utils: - compare: fix comparison between container types. - container: add get_path_name() method, aiming at preventing hitting OS' max filename length. + gzip: replace dest_path generation with self.get_path_name(). + bzip2: replace dest_path generation with self.get_path_name(). * tests: + presenters: - skip html_visuals test if 'sng' binary is not available. + comparators: - test_cointainers: new tests to test cross-container comparisons. - add test_containers.py. [ Chris Lamb ] * comparators: + utils: - file: correct reference to path_apparent_size. + fonts: loosen matching of file(1)'s output to ensure we correctly also match TTF files under file 5.32. + binwalk: - new comparator to deal with (e.g.) concatenated CPIO archives using the new optional python module 'binwalk'. Closes: #820631 * diffoscope.diff: Correct reference to self.buf. * debian/rules: run flake8 during the tests, and fail the build in case the "underfined name" flake8's check fails. * tests/comparators: + test_cpio: check we identify all CPIO fixtures. * main: + print a debugging message if we are reading diff from stdin. * presenters: + html: use logging.py's lazy argument interpolation. * debian/control: bump Standards-Version to 4.1.0. * Code style improvements across all of the codebase. [ Mattia Rizzolo ] * debian/changelog: retroactively close a bug in an old changelog entry. * setup.py: add a check to prevent people from installing diffoscope under python < 3.5 (i.e. python2) and give them a usable error message otherwise. * Code style improvements across all of the codebase. [ Ximin Luo ] * comparators: + add a fallback_recognizes() method to work around file(1)'s bug #876316. Closes: #875282 + add a --force-details flag for debugging. + deb: - if --force-details then don't skip files with identical md5sums either. * presenters: + html: - prune all descendants properly. Closes: #875281 - don't show pointer-cursor when jquery is disabled. * config: + force-set a value if it must be less than another, and it was not set on purpose. Closes: #875451 * readers: convert bytes to str in the right place. * diff: use diff_split_lines everywhere. * difference: + in fmap/map_lines, don't forget about self._visuals. + also copy self._comment properly, compare self._visuals in equals(). * tests/comparators: + test_deb: make test_md5sums less brittle. -- Mattia Rizzolo Fri, 22 Sep 2017 18:53:05 +0200 diffoscope (86) unstable; urgency=medium [ Mattia Rizzolo ] * tests: + binary: skip a test if the 'distro' module is not available. + iso9660: avoid an overly-catching exception. * debian/copyright: coalesce some file paragraphs and update information. [ Guangyuan Yang ] * tests: + iso9660: support both cdrtools' genisoimage's versions of isoinfo. [ Chris Lamb ] * comparators: + xml: Use ``name`` attribute over ``path`` to avoid leaking comparison full path in output. * Tidy diffoscope.progress a little. [ Ximin Luo ] * Add a --tool-prefix-binutils CLI flag. Closes: #869868 * On non-GNU systems, prefer some tools that start with "g". Closes: #871029 * presenters: + html: - Don't traverse children whose parents were already limited. Closes: #871413 [ Santiago Torres-Arias ] * diffoscope.progress: + Support the new fork of python-progressbar. Closes: #873157 -- Mattia Rizzolo Sun, 03 Sep 2017 22:23:06 +0200 diffoscope (85) unstable; urgency=medium [ Mattia Rizzolo ] * tools: + move from the deprecated platform.linux_distribution() to the external python package "distro". Add it as an optioanl dependency, as without it distribution detection (i.e. `diffoscope --list-tools`) won't work. Also add it as a Debian (hard) dependency, as it's a very lightway package, and the usefulness it brings are great. + add a get_package_provider() function, returning the package name that best matches the system. * exc: + in RequiredToolNotFound.get_package(), just call the new get_package_provider() * debian/rules: + recommends the defusedxml python package, to avoid using the python3's standard xml library and its security holes. [ Chris Lamb ] * comparators: + sqlite: - Simplify file detection by rewriting manual `recognizes` call with a `Sqlite3Database.RE_FILE_TYPE` definition. + xml: - Fix EPUB "missing file" tests; they ship a META-INF/container.xml file. [ Ximin Luo ] * comparators: + factor common logic from various comparators into File.recognizes. + more tidying up and making names consistent. + directory: - make stat(1) warning textually like the other warnings. - bump stat(1) warning into an error. - use getfacl(1) before lsattr(1) as it's more general. + apk: - less kludgy way of detecting APKs. Closes: #868486 * main, logging: + restore old logger settings to avoid pytest fail in certain situations. * debian/rules: + add a check to prevent additions of "DOS/MBR" file type. * feeder: + force a flush when writing output to diff. Closes: #870049 * tests/comparators: + directory: - be less strict about the expected test output, to cope with a missing `getfacl`. Closes: #868534 [ Juliana Oliveira Rodrigues ] * comparators: + Add new XML comparator. Closes: #866120 The comparator will use defusedxml if this is installed, to avoid falling in known security holes coming from the XML specification. * tests/comparators: + apk: - fix the tests after the addition of the XML comparator. + image: - fix test_ico_image for identify >= 6.9.8. [ Guangyuan Yang ] * tests/comparators: + device: - fix 2 cases for FreeBSD. -- Mattia Rizzolo Mon, 31 Jul 2017 22:27:45 +0200 diffoscope (84) unstable; urgency=medium [ Ximin Luo ] * comparators: + directory: - raise warning for getfacl and remove a redundant try-clause. - add a --exclude-directory-metadata option. Closes: #866241 * diff: + Restore artificial limit when calculating linediff, to prevent memory blow up. Closes: #865660 * presenters: + text: - fix recursive header display in the text output, deeply-nested headers were not getting indented far enough. + add a PartialString class. + html: - in html-dir mode, put css/icon in separate files to avoid duplication. - split index pages up if they get too big. - add a size-hint to the diff headers and lazy-load buttons. - diffcontrol UI tweaks: * don't toggle buttons for diffs that haven't been loaded yet; * make the diffcontrol headers clickable. - more intuitive "limit" flags, with some backwards-incompatible changes: --max-report-size: Old: in --html-dir this limited only the parent page New: in --html-dir this applies across all pages --max-diff-block-lines: Old: in --html-dir 4 * this number applied across all pages New: in --html-dir this applies across all pages --max-page-size: New flag Applies to the sole --html page, or the top-level --html-dir page --max-report-child-size Renamed to --max-page-size-child: No behavioural changes --max-diff-block-lines-parent Renamed to --max-page-diff-block-lines: Old: Only applied to the top-level --html-dir page New: Applies to the sole --html page or the top-level --html-dir page * main: + temporarily add old flags back for backwards-compatibility. + warn if loading a diff but also giving diff-calculation flags. + implement proper boolean flags to fix test failure in previous commit. * tests: + handle existing but not importable modules. This fixes the tests during the Python 3.6 transition, where some modules (like rpm) exists but are not yet rebuilt for 3.6. + fix progressbar failure that was exposed by the previous importing fixes. + presenters: - skip visual test if tools aren't installed. Closes: #865625 + comparators - sqlite: test for sqlite 3.19. - fsimage: move the guestfs cache out of the default /var/tmp/ into a "more temporary" directory. [ Mattia Rizzolo ] * debian/control: fix Vcs-Git field. [ Chris Lamb ] * debian/control: bump Standards-Version to 4.0.0. [ Daniel Shahaf ] * Fix markup in the man page synopsis. Closes: #866577 Thanks to Niels Thykier for the report. -- Mattia Rizzolo Wed, 12 Jul 2017 12:28:11 +0200 diffoscope (83) unstable; urgency=medium [ Chris Lamb ] * New features: * Add comparator for Fontconfig cache files. * Bug fixes: - Don't fail when run under perversely recursive input files. See for more information. (Closes: #780761) - Prevent a traceback when using --new-file with containers by passing progress_name of the Member and not the member itself. (Closes: #861286) - Drop passing has_differences around, fixing an issue with generating files called '-'. * Cleanups & refactoring: - Reorder and rename FIFOFeeder arguments to prevent tools incorrectly parsing as a SyntaxError. - Refactor HTML and text presenters so they fit the same interface. - Refactor Presenter to a singleton manager. - Split output and configuration of presenters. - Prevent abstraction-level violation by defining visual diff support on the Presenter classes. - Split diffoscope.difference into a feeders module. - Document various variables. - PEP8-ify and tidy a lot of files. [ Ximin Luo ] * New features: - Add --max-container-depth CLI option. - Add various traverse_* methods to Difference. - Weigh elements in progress bar by their size. - Add a reader for the JSON format. - Add a --exclude-command CLI for filtering out long-running commands like "readelf --debug-dump=info". - Don't show +/- controls for differences with no children. - Use unicode chars for the +/- controls instead of punctuation. * Bug fixes: - Fix --exclude control.tar.gz. - Make the progress bar play nicely with --debug. - When enforcing max-container-depth, show which internal files differ, without showing details. - Fix JSON presenter to handle recursion properly. - Avoid a ZeroDivisionError in the progress bar - Fix create_limited_print_func. * Tests: - Fix failing tests due to logging global state. - Add tips about running with TMPDIR=/run/shm. * Cleanups & refactoring: - Remove unnecessary "dest" args to argparse. - Refactor DirectoryContainer to be more similar to Container. - Refactor Container abstract method names. - Remove unused imports and tidy up Container.comparisons(). - rename get_{filtered => adjusted}_members_sizes for consistency. - Move tests/comparators/utils up one directory. - html-dir: show/hide diff comments which can be very large. - Refactor html-dir presenter to a class instance avoiding global state. - Move side-by-side and linediff algorithms to difference.py. - difference: has_children -> has_visible_children, and take into account comments. - Move ydiff/linediff from diffoscope.{difference => diff} to group unified_diff-related things together [ Maria Glukhova ] * New features: - Add visual comparisons for JPEG, ICO, PNG and static GIF images. (Closes: #851359) * Test improvements: - Test that external tools providers are being returned when tool is not found. - Add tests for OutputParserError and ContainerExtractionError. * Cleanups & refactoring: * Ignore text difference if we have a visual one. * Fix link formatting and typo in README. * Rename html_output to compute_visual_diffs and explain its purpose. * Removed duplicated functions from diff.py. [ Mattia Rizzolo ] * Export junit-xml style test report when building on Jenkins. [ anthraxx ] * Extend external Arch Linux tools list. -- Chris Lamb Sun, 18 Jun 2017 15:34:59 +0800 diffoscope (82) experimental; urgency=medium [ Chris Lamb ] * New features: - Add support for comparing Pcap files. (Closes: #858867) - Add support for .docx and .odt files via docx2txt & odt2txt. (Closes: #859056) - Add support for PGP files via pgpdump. (Closes: #859034) - Add support for comparing Ogg Vorbis files. * Bug fixes: - Don't crash on invalid archives; print a useful error instead. (Closes: #833697) - Ensure tests and the runtime environment can locate binaries in /usr/sbin (eg. tcpdump) * Tests: - Ensure that PATH is modified. - Ensure @tool_required raises RequiredToolNotFound. - Don't assume that /sbin/init exists; locate any /sbin binary manually and then test for that. This should prevent FTBFS on travis-ci.org. - Show packages installed in report output. * Misc: - comparators.bzip2: Don't print error output from bzip2 call. - comparators.pcap: Show the delta, not the absolute time. - Use /usr/share/dpkg/pkg-info.mk over manual calls to dpkg-parsechangelog in debian/rules. - Document PYTHONPATH usage when running tests in README.Source. - Add internal documentation for @tool_required decorator. [ beuc@beuc.net ] * Display differences in zip platform-specific timestamps. (Closes: #859117) [ Ximin Luo ] * Add support for R .rds and .rdb object files. [ Vagrant Cascadian ] * Add support for .dtb (device tree blob) files (Closes: #861109). -- Chris Lamb Wed, 26 Apr 2017 16:17:57 +0200 diffoscope (81) experimental; urgency=medium [ Chris Lamb ] * Correct meaningless "1234-content" metadata when introspecting files within archives. This was a regression since #854723 due to the use of auto-incrementing on-disk filenames. (Closes: #858223) * Refactor get_compressed_content_name. [ Ximin Luo ] * Improve ISO9660/DOS/MBR check. -- Chris Lamb Mon, 27 Mar 2017 16:21:17 +0100 diffoscope (80) experimental; urgency=medium * Ensure that we really are using ImageMagick and not, for example, the GraphicsMagick compatibility layer installed by graphicsmagick-imagemagick-compat. (Closes: #857940) * Factor out the unicode decoding of the identify -version output. * travis.yml: Don't build tags. -- Chris Lamb Thu, 16 Mar 2017 17:06:45 +0100 diffoscope (79) experimental; urgency=medium [ Chris Lamb ] * Extract SquashFS images in one go rather than per-file, speeding up (eg.) Tails ISO comparison by ~10x. * Support newer versions of cbfstool to avoid test failures. (Closes: #856446) * Skip icc test that varies on endian if the Debian-specific patch is not present. (Closes: #856447) * Compare GIF images using gifbuild. (Closes: #857610) * Also interpret "DOS/MBR boot sector" files as ISO images as they may have been processed by isohybrid. * Progress bar: - Hide bar if we are running with --debug mode. - Update prior to working on an item so the displayed filename is correct. [ Maria Glukhova ] * Improve AndroidManifest.xml comparison for APK files. - Indicate the AndroidManifest.xml type. (Closes: #850758) -- Chris Lamb Thu, 16 Mar 2017 09:38:16 +0100 diffoscope (78) unstable; urgency=medium [ Brett Smith ] * comparators.json: + Catch bad JSON errors on Python pre-3.5. Closes: #855233 [ Chris Lamb ] * tests: + Move normalize_zeros to more generic `utils.data` module. + Fix tests that call xxd fail on jessie due to output change. Closes: #855239 [ Ed Maste ] * comparators.directory: + Assume BSD-style stat(1) on FreeBSD. Closes: #855169 -- Mattia Rizzolo Sun, 26 Feb 2017 17:26:48 +0100 diffoscope (77) unstable; urgency=medium [ Chris Lamb ] * tests/comparators/utils: + Correct logic of module_exists, ensuring we correctly skip in case of modules containing a dot in their name. Closes: #854745 * comparators/utils/libarchive: + No need to track archive directory locations. * Add --exclude option. Closes: #854783 * Add PyPI badge to README.rst. * Update .travis.yml from http://travis.debian.net. [ Mattia Rizzolo ] * Add CVE reference to the changelog of v76. * Add my key to debian/upstream/signing-key.asc. [ Ximin Luo ] * comparators/utils/libarchive: + When extracting archives, try to keep directory sizes small. -- Mattia Rizzolo Mon, 13 Feb 2017 16:25:02 +0100 diffoscope (76) unstable; urgency=medium [ Chris Lamb ] * Extract archive members using an auto-incrementing integer, avoiding the need to sanitise filenames and avoiding writes to arbitrary locations. (Closes: #854723 - CVE-2017-0359) [ Ximin Luo ] * Simplify call to subprocess.Popen -- Chris Lamb Fri, 10 Feb 2017 11:37:52 +1300 diffoscope (75) unstable; urgency=medium [ Chris Lamb ] * Fix ImportError in Debian comparator tests. This was caused by not handling the case where ``importlib.find_spec`` was testing for a submodule (ie. ``debian.Deb822``) where it will attempt to import the ``debian`` module and raise an exception if it does not exist. Thanks to Iain Lane for initial patches. (Closes: #854670) [ Ximin Luo ] * Remove pointless use of a thread -- Chris Lamb Fri, 10 Feb 2017 09:28:47 +1300 diffoscope (74) unstable; urgency=medium * Add missing Recommends for comparators. This was a regression introduced in version 71 due to lazily-importing them; they were then not available when we called "--list-tools=debian" during package build. (Closes: #854655) -- Chris Lamb Thu, 09 Feb 2017 16:58:28 +1300 diffoscope (73) unstable; urgency=medium * debian/tests/pytest: Remove spurious clipboard contents. -- Chris Lamb Thu, 09 Feb 2017 13:24:59 +1300 diffoscope (72) unstable; urgency=medium * Fix autopkgtest failures when Recommends are not installed. (Closes: #854593) * Specify in HTML output. (re. #849411) * Tests: - Add a "@skip_unless_module_exists" decorator. - Show local variables in tracebacks. -- Chris Lamb Thu, 09 Feb 2017 12:49:40 +1300 diffoscope (71) unstable; urgency=medium [ Chris Lamb ] * New features: - Add a machine-readable JSON output format. (Closes: #850791) - Show results from debugging packages last. (Closes: #820427) - Add a --max-text-report-size option. (Closes: #851147) * Bug fixes: - Clean all temp files in signal handler thread instead of attempting to bubble exception back to the main thread. (Closes: #852013) - Prevent FTBFS by loading fixtures as UTF-8 in case surrounding terminal is not Unicode-aware. (Closes: #852926) - Fix errors when comparing directories with non-directories. (Closes: #835641) - Fix behaviour of setting report maximums to zero (ie. no limits) * Tests: - Test the RPM "fallback" comparison. - Test the Deb{Changes,Buildinfo,Dsc} fallback comparisons. - Test --progress and --status-fd output. - Add tests for symlinks differing in destination. - When comparing two empty directories, ensure that the mtime of the directory is consistent to avoid non-deterministic failures. - Smoke test profiling output. - Ensure we ignore invalid JSON files correctly. - Ensure 2nd source of a Difference is a string, not just the 1st. - Don't report on test coverage for some internal error messages. * Misc: - Add docs about releasing signed tarballs. - Drop the incomplete list of external tools from README.rst. - Add debian/watch file with cryptographic signature verification. - Drop CpioContent command now that we use libarchive. - Use a singleton to manage our Comparator classes. - Many small optimisations and code cleanups. [ Brett Smith ] * diffoscope.diff: Improve FIFO writing robustness. [ Ximin Luo ] * Fix bug introduced in commit 36d1c964 that only worked "accidentally". * Fix lazy expression; filter is lazy in Python 3. [ Mattia Rizzolo ] * Override the debian-watch-file-in-native-package lintian tag. [ anthraxx ] * Arch package changed from cdrkit to cdrtools. [ Holger Levsen ] * Restore history section in README, explaining this was started in Debian. -- Chris Lamb Wed, 08 Feb 2017 13:02:01 +1300 diffoscope (70) unstable; urgency=medium [ Mattia Rizzolo ] * comparators + haskell: add a comment describing the file header. Thanks to James Clarke for all the investigation done. * tests: + Skip two more tests requiring a x86-64-capable binutils. This fixes the tests on ppc64el. * CONTRIBUTING: misc updates, clearer info about how to submit a Debian bug. [ James Clarke ] * comparators: + haskell: Properly extract version from interface files. What the code did before was just totally wrong, and worked only by chance (and only on little endian systems). This also fixes the test suite when run on big endian systems. [ Chris Lamb ] * comparators: + haskell: Also catch CalledProcessError, not just OSError. * presenters: + Move text presenter to use Visitor pattern. + Add markdown output support. Closes: #848141 + Add RestructuredText output format. + Instantiate our presenter classes directly instead of wrapping a method. + Use an optimised indentation routine throughout all text presenters. + text: Remove superfluous empty newlines from diff. * tests: + Split main and presenter tests. + Actually compare the output of text/ReST/markdown formats to fixtures. + Drop output_* calls that are inconsistently applied to differences. + Add tests for HTML output. + Add a test comparing two empty directories. + Test --text-color output format. + Test that no arguments (beyond the filenames) prints the text output. + Don't warn about coverage lines that raise NotImplementedError. + Increase coverage by adding "# noqa" in relevant parts. * Add build status to README.rst. [ Brett Smith ] * diffoscope: + Specify choices for --list-tools switch. + Improve --help output. Closes: #852015 * CONTRIBUTING: Refresh instructions for contributing to diffoscope. [ anthraxx ] * tools: switch Arch Linux dependency for pedump to mono. -- Mattia Rizzolo Thu, 26 Jan 2017 16:39:10 +0100 diffoscope (69) unstable; urgency=medium [ Chris Lamb ] * Skip tests if binutils can't handle the object file format. Based on a patch by Mattia Rizzolo. (Closes: #851588) * Move external tool definitions out of misleading "exceptions" module. * Save some complicated logic by setting default RE_FILE_{EXTENSION,TYPE} * Test --html-dir option. * Misc: * Add missing `data` imports. - Inherit GzipFile from File, not object. - Remove unused imports in comparator tests. - Consistently space out environment exports in debian/rules. [ Mattia Rizzolo ] * If both RE_FILE_TYPE and RE_FILE_EXTENSION are defined, AND them * Use the path attribute of the specialized file instead of the original name in tests. * tests/main: * Shorten argument lists by unpacking common arguments. * Disable jQuery while testing --htmldir so tests can run without it. * tests/comparators: * Refactor into packages with smaller modules. * Rename load_fixture() to init_fixture(). * Add a load_fixture() function wrapping both init_fixture() and data(). -- Chris Lamb Tue, 17 Jan 2017 11:33:54 +1100 diffoscope (68) unstable; urgency=medium [ Chris Lamb ] * Don't blow up if directory containing ELF debug symbols already exists. (Closes: #850807) * Fix .APK extration when provided with absolute filenames. (Closes: #850485) * Support comparing .ico files using img2txt. (Closes: #850730) * comparators.utils.file: If we don't have an archive-extraction tool (eg. apktool), don't blow up when attempting to unpack it. * Include magic file type when we know the file format but can't find file-specific details. (Closes: #850850) * Ensure fake "APK metadata" file appears first, fixing non-deterministic tests/output. * Correctly escape value of href="" elements (re. #849411) * Optimisations: - Disable profiling entirely (unless enabled) for a 2%+ optimisation - Compile APK filename regex instead of generating it each loop. * Logging: - Log tempfile cleanup process - Log when we add a progress observer. - Drop milliseconds from log output * Misc: - Many unused import removals, indentation changes, etc. - Fix duplicated word and long line errors in debian/changelog. - Suggest some promotion in post-release documentation. [ Maria Glukhova ] * comparators/device: don't crash when comparing a non-device against a device (Closes: #850055) * Remove archive name from apktool.yml and rename it. (Closes: #850501) * Zipinfo included in APK files comparison. (Closes: #850502) - Add some tests for APK comparator. * Add image metadata comparison. (Closes: #849395) * Ensure imagemagick version is new enough for image metadata tests. [ Mattia Rizzolo ] * Skip the openssh_pub_key test if the version of ssh is < 6.9. * comparators/icc: rename RE_FILE_EXTENSION to RE_FILE_TYPE, as that's what the regular expression is looking for. * Make use of a new mechanism to remove a bunch of recognizes() methods dealing with simple RE_FILE_TYPE matching. -- Chris Lamb Mon, 16 Jan 2017 11:24:22 +1100 diffoscope (67) unstable; urgency=medium [ Chris Lamb ] * Optimisations: - Avoid multiple iterations over archive by unpacking once for an ~8X runtime optimisation. - Avoid unnecessary splitting and interpolating for a ~20X optimisation when writing --text output. - Avoid expensive diff regex parsing until we need it, speeding up diff parsing by 2X. - Alias expensive Config() in diff parsing lookup for a 10% optimisation. * Progress bar: - Show filenames, ELF sections, etc. in progress bar. - Emit JSON on the status file descriptor output instead of a custom format. * Logging: - Use more-Pythonic logging functions and output based on __name__, etc. - Use Debian-style "I:", "D:" log level format modifier. - Only print milliseconds in output, not microseconds. - Print version in debug output so that saved debug outputs can standalone as bug reports. * Profiling: - Also report the total number of method calls, not just the total time. - Report on the total wall clock taken to execute diffoscope, including cleanup. * Tidying: - Rename "NonExisting" -> "Missing". - Entirely rework diffoscope.comparators module, splitting as many separate concerns into a different utility package, tidying imports, etc. - Split diffoscope.difference into diffoscope.diff, etc. - Update file references in debian/copyright post module reorganisation. - Many other cleanups, etc. * Misc: - Clarify comment regarding why we call python3(1) directly. Thanks to Jérémy Bobbio . - Raise a clearer error if trying to use --html-dir on a file. - Fix --output-empty when files are identical and no outputs specified. - Wrap changelog line to avoid Lintian warning. [ Reiner Herrmann ] * Extend .apk recognition regex to also match zip archives (Closes: #849638) [ Mattia Rizzolo ] * Follow the rename of the Debian package "python-jsbeautifier" to "jsbeautifier". [ siamezzze ] * Fixed no newline being classified as order-like difference. -- Chris Lamb Wed, 04 Jan 2017 16:56:36 +0000 diffoscope (66) unstable; urgency=medium [ Chris Lamb ] * Update dex_expected_diffs and test requirement to ensure test compatibility with enjarify >= 1.0.3. (Closes: #849142) * Print the detected version in @skip_unless_tool_is_at_least test utility. [ Maria Glukhova ] * Add detection of order-only difference in plain text format. (Closes: #848049) [ anthraxx ] * Add OpenSSH Arch package to Recommends. -- Chris Lamb Sat, 24 Dec 2016 19:18:30 +0000 diffoscope (65) unstable; urgency=medium [ Chris Lamb ] * Avoid unpacking packages twice when comparing .changes. (Closes: #843531) * Add a simple profiling framework (enabled via --profile) which tracks: - Container extraction, opening and closing times. - The "compare_files" top-level/recursive method. - The time taken to produce the various output formats. - All "has_same_content_as" and "recognizes" methods. - External commands that wrap "@tool_required". - External commands that use "make_feeder_from_command". - The internal/external "cmp" methods. - Some manual calls to subprocess.check_output(). * Tidy log messages: * Clarify the meaning of the compare_files and Binary.has_same_content debug messages. * Skip low-value "X is already specialized" message. * Correct "instantiating" typo. [ Emanuel Bronshtein ] * Use ssh-keygen for comparing OpenSSH public keys * Remove inline styles from col elements -- Chris Lamb Fri, 23 Dec 2016 11:58:15 +0000 diffoscope (64) unstable; urgency=medium [ Chris Lamb ] * Avoid shelling out to colordiff by implementing highlighting in Python directly. * Split out trydiffoscope client and binary package from main diffoscope repository so that it can be more-easily released on PyPI. * Memoize calls to ``distutils.spawn.find_executable`` to avoid excessive stat(1) syscalls. * Remove temporary profiling file introduced in 97bddd18a. * comparators.directory: - Correct `source` attribute of lsattr-based Difference instances. - Add comment regarding why difficult to optimise calls to lsattr * Internally guarantee to all progress observers that we will be processing something. * bin/diffoscope: - Ensure that running from Git always uses that checkout's modules. - Use os.path.join "properly" as we are already using it. - Use typical sys.path.insert(0, ...) method to modify sys.path. - Use immutable tuple over mutable list for clarity. * comparators.debian: No need to keep .buildinfo file descriptor open. * Suggest command-line for signing of PyPI uploads. * Improve documentation of new tests/conftest.py file. [ Maria Glukhova ] * Remove test data causing problems during build with Python 3.4. * Change icc-recognizing regexp to reflect changes in file type description. (Closes: #848814) [ Brett Smith ] * set_locale should call tzset. (Closes: #848249) * Ensure set_locale fixture runs before all tests. [ Emanuel Bronshtein ] * Use js-beautify as JavaScript code beautifier for .js files (with tests). * CSS & HTML changes: - Disable referrer and window.opener leakage. - Disable compatibility mode usage in IE. - Use double quotes for HTML attributes. - Fix unclosed element span. - CSS optimizations. - Add fallback color to rgba usage. - Fix CSS markup warnings. * Change all HTTP URLs to HTTPS where applicable. [ Baptiste Daroussin ] * comparators/directory: add compatibily with FreeBSD's getfacl. * Improve portability by not relying on /dev/fd. [ Reiner Herrmann ] * Improved support for Android apk files. * Fix wording in Comparators.get_members comment. [ Mattia Rizzolo ] * presenters/html: Namespace the diffoscope CSS class. -- Chris Lamb Thu, 22 Dec 2016 10:37:36 +0000 diffoscope (63) unstable; urgency=medium * Add myself to Uploaders. * Greatly improve speed for large archives by fixing O(n^2) complexity for archive member lookup. - There is still O(n^2) complexity for archive member extraction, but this is less noticeable for various reasons and would require more complexity to fix, so for now is left as a task for the future. * Text output: add coloured diff support via colordiff(1). * Html-dir output: add +/- buttons to fold sub-diffs (i.e. toggle their visibility) as well as the whole diff itself. As with similar features in other programs, the effect affects all descendants if you shift-click. -- Ximin Luo Fri, 02 Dec 2016 12:10:04 +0100 diffoscope (62) unstable; urgency=medium [ Chris Lamb ] * progress: Pass the fileobj to the print(..) function, not str.format. Thanks to Marius Gedminas . * Move diffoscope.Config to a more-standard and simpler singleton pattern and validate constraints on every __setattr__. [ Maria Glukhova ] * tests/{dex,java}: Skip the java tests if javap is older than 1.8. This fixes test_java and test_dex failing in jessie-backports. See #838984 [ Michel Messerschmidt ] * comparators/zip: Add rudimentary support for OpenDocumentFormat files. [ Mattia Rizzolo ] * debian: bump debhelper compat level to 10, no changes needed. * comparators/ppu: + don't do run a full ppudump while only looking for PPU file version. + ignore decoding errors from ppudump while filtering the output. * tests/ppu: skip some PPU tests if ppudump is < 3.0.0. Closes: #838984 * tests: skip test using a format accepted by older pytest. Closes: #841146 [ Daniel Shahaf ] * comparators/json: detect order-only differences and print them nicely. Closes: #839538 -- Mattia Rizzolo Tue, 01 Nov 2016 15:33:45 +0000 diffoscope (61) unstable; urgency=medium [ Mattia Rizzolo ] * Skip rlib tests if the "nm" tool is missing. (Closes: #837742) * Use dedicated xxd binary package instead of vim-common. * autopkgtest: Allow stderr for the basic-command-line test. * d/rules: make it possible to backport without changing the "upstream" version. [ Maria Glukhova ] * Catch an error when we can't read files in has_same_content_as(). (Closes: #835642) [ Chris Lamb ] * Add the ability track the (approximate) progress throughout diffoscope run: - Add a graphical progressbar and show by default if STDOUT is a TTY. - Add a --status-fd argument to output machine-readable status to the specified file descriptor. [ Ximin Luo ] * Add a --output-empty option, useful for batch scripts. * Improve --help text and group the optional arguments based on topic. * Add a script to check sizes of dependencies. * tests/basic-command-line: check exit code and use a more complex example. * Provide better advice about what environment variable to set to make the console work. -- Chris Lamb Wed, 28 Sep 2016 11:44:25 +0100 diffoscope (60) unstable; urgency=medium [ Chris Lamb ] * debian/rules: + Run tests with python3-coverage and generate reports post-build. * CONTRIBUTING: Add PyPI reference. * Comparators: + Avoid ugly DRY violations in diffoscope.comparators.__init__ by dynamically importing classes via a single list. + git: Specify paths as strings as required since b7830b5cb. + elf: - Mask more warnings (eg. "readelf: Error: the dynamic segment offset" or "size exceeds the size of the file"). - Specify string format arguments as logging function parameters, not using interpolation. + json: Correct behaviour of JSON comparator when file does not exist. * Presenters: + html: - Use html.escape over xml.sax.saxutils.escape. - Don't use unsafe cgi.escape method as its ``quote`` kwarg — which enables escaping of quotation marks — is False by default. * Code clean-up: + Tidy imports. + Split exceptions out into dedicated diffoscope.exc module. + Use try-except idiom instead of ``if`` in RequiredToolNotFound.get_package + Prefer kwargs[x] = kwargs.pop(x, 'default') idiom over ``if`` statements. * tests: + Factor out ugly os.path.join to a utility method. + Drop unused try_except in tests/conftest. + Add GitIndex tests to bring coverage of comparators/git.py to 100%. + Add tests for Haskell comparator. - Skip Haskell tests if GHC is not installed. - Skip Haskell tests if GHC version does not match. Closes: #835055 + Add test in JSON comparator for non-existing files. + Rewrite lengthy "[..] skipIf [..] tool_missing" with a @skip_unless_tools_exist decorator. + Add tests for skip_unless_tools_exist helper. + Rename tests/comparators/conftest.py -> tests/comparators/utils.py. + Avoid Don't-Repeat-Yourself violations by factoring out fixture loading. + Avoid more DRY violations by factoring-out non-existing file tests. + Remove some other unused imports from comparator tests. + Check rendering of text and HTML presenters when checking non-existing files. + Use `pytest.xfail` over `assert False`. [ Mattia Rizzolo ] * debian/control: + Reinstated build profiles, now that dh-python is fixed (see #834238). + Version the build-dependency on dh-python, so it supports build profiles. + Add more nocheck build profiles. + Bump dependencies on debhelper and dpkg-dev to assure build profile support is available. + Add Build-Dependency on fontforge-extras for showttf (run during tests) + Alternate Build-Dependency on default-jdk-headless|default-jdk, to ease backporting to older Debian releases. * debian/rules: + Don't install '/usr/lib/python3/dist-packages/.coverage'. + Run the basic-command-line test during package build. + Be even more verbose about failing tests. + Allow building a mismatching version between diffoscope and the debian changelog if the target distribution is UNRELEASED. * Comparators + ppu: - Unbreak ppu_version detection. - Put code out of the context manager, it doesn't need to be within. * trydiffoscope: add copyright/license header. * autopkgtest/basic-command-line: + Enable running basic-command-line test without ADTTMP being set. + Be a bit more verbose about what is being tested. + Also test return code when passing an invalid command line flag. + Force LC_ALL=C.UTF-8, so that diffoscope can always output something. * test: + Factor out a tools_missing() function. + Rewrite tool_older_than() into skip_unless_tool_is_older_than(). + Skip test_squashfs.py.test_superblock if squashfs is too old. + Normalize xxd's output so that we can compare jessie's xxd with stretch's. * add default-jdk to the alternate packages for javap for Debian; default-jdk-headless is not available in older Debian releases. [ Satyam Zode ] * Ignore differences in .buildinfo if all the other files listed in .changes are identical. In those cases any differences in .buildinfo files are irrelevant, and are actually a feature (as it indicates two reproducible builds with different environment). [ Jérémy Bobbio ] * Properly skip tests requiring python-debian when unavailable. [ Ximin Luo ] * Show the timestamp when logging, to detect which steps take longer. * Add a --no-max flag to disable all limits. * Have --max-report-size honour 0 to mean "no limit". * Comparators: + cbfs: only scan whole file when the filename ends with ".rom". + binary: Suppress decimal line numbers for xxd output. * Increase default --max-diff-input-lines to 2^20 (1048576) from 100000. * Rename --no-max-limits to --no-default-limits, a more accurate name. * presenters/html: html-dir output: + Split large diffs across several child pages. Also add some flags so html-dir behaviour is easier to reason about. + Use 4 times the given --max-diff-block-lines. This way, '--html x.html --html-dir y' gives reasonable output for both. * difference: + Fix behaviour for max-diff-block-limit=1 and don't report when 0 lines are removed. + Don't truncate diff output by default, instead add a separate flag --max-diff-block-lines-saved (infinite by default) to do so. -- Mattia Rizzolo Sun, 11 Sep 2016 16:14:33 +0000 diffoscope (59) unstable; urgency=medium [ Chris Lamb ] * SquashFS test_testing: - Don't assume that user and group are 5 characters long in squashfs test_listing. - Drop test; simply too unreliable and/or has too many requirements to satisfy (eg. shorter usernames) for it to not be skipped. * Difference class: - Ensure that we pass str instances to our Difference class as paths, otherwise we can't be sure we can render them. For example, passing a class here breaks the HTML renderer. - Add test for type checking of path1/path2/source. - Pass a str for the path in the JSON comparator, fixing the HTML reporting of JSON output. * When looping over JQUERY_SYSTEM_LOCATIONS, actually use the variable we are looping with when performing the symlink(2) call. * trydiffoscope: - Add manpage for trydiffoscope. - Write trydiffoscope console output as UTF-8, even if STDOUT claims it doesn't support it. * debian/rules: - Make separate calls to dh_python3 for diffoscope and trydiffoscope to avoid both getting the same Recommends substvar. - Use a pattern-based rule for rst2man-based manpages instead of hard-coding "diffoscope.1". - Dynamically calculate manpages to generate over hardcoding. * .gitignore: Ignore all generated manpages, not just diffoscope.1. [ Holger Levsen ] * ./CONTRIBUTING: - Add new file. - Explain what to look out for when uploading diffoscope. -- Chris Lamb Mon, 15 Aug 2016 09:54:48 +0100 diffoscope (58) unstable; urgency=medium * Shorten Description of trydiffoscope to appease Lintian. * Make squashfs test_listing test more robust: - Add ".in" suffix to squashfs listing expected diff as we are about to template it properly. - Replace $USER with the current user with uid 1000. - Move test_listing replacements to a loop so we can easily add more. - Don't assume that the test environment as 4 CPUs in squashfs.test_listing - Don't assume default group is the same name as the user in test_listing. -- Chris Lamb Sun, 14 Aug 2016 10:22:19 +0100 diffoscope (57) unstable; urgency=medium [Chris Lamb] * Add myself to Uploaders. * Add try.diffoscope.org command-line client in new binary package "trydiffoscope" to save installation of dependencies: - Open files in binary mode to support comparing binary files. - Optionally open URL in web browser. - Optionally poll locally until result is available. - Move to version 2 of API, don't continue to poll on error. - Correct and improve help text. * Code cleanups: - Tidy PROVIDERS dict in diffoscope/__init__.py. - Tidy OS_NAMES dict. - Correct indentation levels in various files. - Drop unused imports. - platform.get_linux_distribution() will break in Python 3.7. - Don't name first argument of Difference.from_command "cls" as it's not a classmethod. - comparators/directory.py: Call logger.warning over logger.warn. - Rename diffoscope.__main__ to diffoscope.main as its not a "real" magic name. - Raise NotImplementedError() instances over NotImplemented classes. - Add short option for trydiffoscope --url. - Rewrite trydiffoscope to match diffoscope's command-line API. - Use keepalive in trydiffoscope client to avoid new HTTP requests. - Highlight lines via HTML/CSS when hovering over a line to make it easier to visually track. - Rename debian/install -> debian/diffoscope.install now we have multiple binary packages. * Add a JSON comparator. - Add tests for JSON comparator. - Move parsing to JSONFile.recognizes - Ensure decode errors in JSON comparator are not fatal. * Ignore /.*eggs and /.cache - they get created when running tests. * Reflow long dh_python3 call in debian/rules. * Use dict.get fallback to shorten OS_NAMES lookup in --list-tools. * --list-tools: - Output --list-tools in RFC822 format to make parsing less brittle. - Print "no package mapping" in --list-tools to stderr, not stdout. - Remove unused ``reduce`` import. - Reflow long PROVIDERS lookup. * Add .travis.yml from http://travis.debian.net/ * Don't skip squashfs test_listing test; we can workaround it, as long as we have a uid 1000. * Drop "Testsuite: autopkgtest" in debian/control; it is added automatically by dpkg-source version 1.17.11. [Mattia Rizzolo] * autopkgtest: be more verbose when running the tests * debian/control: - Mark build-dependency needed only for tests with a build profile (reverted as they break dh-python) - add more build-dependencies to be able to run more tests at build time - default-jdk-headless is enough to have javap, instead of all of default-jdk * debian/rules: - be more verbose when running the tests, in particular, show why tests are being skipped - teach pybuild where to put diffoscope's files * do not try to execute the command if the command is not available [Ximin Luo] * Add support for reading LLVM bitcode files - Ignore line numbers because different llvm-dis versions output extra metadata - Disable the llvm-dis test if the version is lower than 3.8 * Add support for reading Rust LLVM object files * Add test for rlib files, helping also to test ArFile, LlvmBitCodeFile and RustObjectFile * Fix failing directory test * Add support for reading the symbol table to ArFile * Fix typo in tool_older_than - Remove debugging print from tool_older_than [anthraxx] * skip rlib test if llvm-dis tool is missing -- Chris Lamb Sat, 13 Aug 2016 23:46:42 +0100 diffoscope (56) unstable; urgency=medium [ Jérémy Bobbio ] * Fix maybe_decode() so that it actually works. [ Chris Lamb ] * Mask EPIPE to avoid ugly tracebacks when eg. prematurely terminating $PAGER. * Add git index file comparator. * Drop unused imports in Ar comparator. [ Ximin Luo ] * Add support for AR archives (including Rust .rlib files). * Add some more documentation for ArFile/ArContainer. * RequiredToolNotFound.PROVIDERS dict values are package names, not binary names. -- Reiner Herrmann Thu, 28 Jul 2016 00:02:56 +0200 diffoscope (55) unstable; urgency=medium [ anthraxx ] * Fix sqlite3 magic recognition when using file >= 5.27. (Closes: #830434) [ Satyam Zode ] * Add argument completion feature to diffoscope. (Closes: #826711) [ Chris Lamb ] * Improve message when data differs. (Closes: #827981) [ Reiner Herrmann ] * Clarify the input arguments. (Closes: #826894) [ Holger Levsen ] * Add link to homepage in HTML output. [ Rainer Müller ] * python-magic >=0.4.12 does not require decode. -- Reiner Herrmann Fri, 15 Jul 2016 21:50:29 +0200 diffoscope (54) unstable; urgency=medium * Fix syntax in RequiredToolNotFound.PROVIDERS. This caused --list-tools to miss entries, and by it missing Recommends in the Debian package. -- Mattia Rizzolo Fri, 03 Jun 2016 16:16:02 +0000 diffoscope (53) unstable; urgency=medium [ Reiner Herrmann ] * In the directory comparator, fall back to current directory instead of empty name. (Closes: #820624) * Improve deb(5) support. (Closes: #818414) [ Mattia Rizzolo ] * debian/control: add myself to Uploaders. * Clean up temporary debuglink files. * Fix FileNotFoundError with broken symlinks. (Closes: #818856) * Decode Md5sumsFile in utf-8. (Closes: #823874) * Always suffix temporary files with '_diffoscope'. * Rewrite sanity check for the version to always run every time debian/rules is invoked, not only during a binary build. [ Ed Maste ] * Add FreeBSD packages for required tools. [ Ceridwen ] * Add README.rst to MANIFEST.in. -- Mattia Rizzolo Fri, 03 Jun 2016 14:23:16 +0000 diffoscope (52) unstable; urgency=medium [ Mattia Rizzolo ] * debian/gbp.conf: add a conf to have gbp tag the releases how we like them. [ Holger Levsen ] * Drop transitional debbindiff package. * debian/control: Drop XS-Prefix from Testsuite: field, thanks lintian. * Mention --max-report-size only once in the manpage. (Closes: #819956) [ Satyam Zode ] * Fix typo in documentation. [ Reiner Herrmann ] * Bump Standards-Version to 3.9.8, no changes required. * Let objdump demangle symbols for better readability. * Install bin/diffoscope instead of auto-generated script. (Closes: #821777) -- Reiner Herrmann Wed, 20 Apr 2016 20:28:03 +0200 diffoscope (51) unstable; urgency=medium * Team upload. * Re-upload, the last uploaded tarball was broken, missing test files. -- Mattia Rizzolo Sun, 28 Feb 2016 11:56:35 +0000 diffoscope (50) unstable; urgency=medium [ Jérémy Bobbio ] * Remove myself from uploaders [ Reiner Herrmann ] * Show line ordering variation in deb md5sums * Reset mtimes of test directories and ignore ctimes (Closes: #815171) * Add comparator for Postscript files -- Holger Levsen Sat, 27 Feb 2016 19:37:20 +0100 diffoscope (49) unstable; urgency=medium [ Jérémy Bobbio ] * Don't crash when we can't find the debug file in a matching debug package. This repairs diffoscope for xserver-xorg and other packages. * Use libarchive to read metadata from ar archives. The output is more precise and less dependent on binutils version. The command line `ar` tool is not used any more so remove it from the required tools. * Split readelf --debug-dump output when examining ELF files. Based on a patch by Dhole. * Keep both .debug_str and .zdebug_str as ElfSection. Thanks to Niels Thykier for noticing the problem. * Fix a logic error in _install_debug_symbols. Thanks anthraxx for the report and the fix. * Use recursive containers for directory and only look at files with ending in .deb when looking for Build IDs. Both avoid looking at too many files when searching for matching debug packages. Thanks Helmut Grohne and Steven Chamberlain for the reports and tests. (Closes: #813052) * Add support for ICC profiles. This adds a Recommends on colord in Debian. * Harmonize spaces and commas in package list. * Update PPU files test data for FPC 3.0.0. * Update exepcted javap output for OpenJDK 1.8. * Stop specializing files from directories earlier than necessary. [ anthraxx ] * Adding cd-iccdump package reference for Arch Linux. [ Mattia Rizzolo ] * Use HTTPS in Vcs-Git. [ Holger Levsen ] * Bump standards version to 3.9.7, no changes needed. * Use /git/ instead /cgit/ in Vcs-Browser. -- Jérémy Bobbio Wed, 17 Feb 2016 18:12:45 +0100 diffoscope (48) unstable; urgency=medium * Open debian/control file in binary mode (Closes: #812524) * Fix recognizes() for files ending in .buildinfo but without a Checksums-Sha256 field. (Closes: #812534) * Fix finding debug packages with multiple Build-Ids. * Cleanup how arguments are given to readelf for sections. * Only pass --decompress to readelf when the option is supported. This restores compatibility with older versions of binutils. * Skip dbgsym tests if the debian Python module is not available. -- Jérémy Bobbio Tue, 26 Jan 2016 12:13:57 +0100 diffoscope (47) unstable; urgency=low * Don't show a difference for identical but long diff inputs (e.g. objdump output). This should make diffoscope run longer for large diff inputs, but more correct reports worths it. * Fix symbol ignore regexp for ELF files. * Ask readelf to decompress sections before dumping their content. * Don't redefine .name() in Archive when its already defined in File. * All files can now belong to a container. This will help us implement cross-file analysis. * Update requirements for ELF tests. * Sort file order when comparing directories. * Use Python OrderedDict instead of keeping a list of sections in ELF container. * Install detached symbols from debug .deb before comparing ELF files. This means objdump output should have line numbers for Debian packages built with recent debhelper as long as the associated debug package is in the same directory. * Add support for Debian .buildinfo files. -- Jérémy Bobbio Sat, 23 Jan 2016 18:08:33 +0000 diffoscope (46) unstable; urgency=low [ Dhole ] * Improve ELF comparisons by performing comparisons section by section. (Closes: #808197) [ Jérémy Bobbio ] * Further split readelf output when examining ELF files. * Skip dumping ELF sections that are already covered by previous readelf calls to avoid redundant output. Thanks Mike Hommey for the report. (Closes: #808267) * Fix ELF comparisons against non-existing files. * Filter symbols for IP-relative ops from ELF disassembled output as they will create differences that don't really exist. Thanks Mike Hommey for the report and test cases. (Closes: #808207) * Add forgotten requirements for tests with non-existing files. * Improve tests for comparisons against non-existing files. * Respect order of containers when performing comparisons. It makes the output somewhat nicer, especially for things that are expected to be in a certain order, like ELF sections. * Fix comparisons of directory with broken symlinks. Thanks Tuomas Tynkkynen for reporting the issue. (Closes: #810825) -- Jérémy Bobbio Tue, 19 Jan 2016 16:46:47 +0100 diffoscope (45) unstable; urgency=medium [ Rainer Müller ] * Fix typo in Mach-O comparator. [ Jérémy Bobbio ] * Ensure that we always get path names from libarchive as str. (Closes: #808541) * Read ext4 reference diff using UTF-8 to ensure that the test suite works when run under various locales. * Replace file path by a fixed placeholder in readelf and objdump output. This will work better when comparing ELF files given on the command line. * Read lines using an iterator instead of loading a full list in memory. This greatly help diffoscope when running on large binaries. Thanks Mike Hommey for the report and good test case. (Closes: #808120) * Properly report lines we can't parse in squashfs listing. * Correctly parse squashfs device entries with device minors larger than 3 digits. Thanks sajolida for providing the samples. * Use libarchive to list files in tar and cpio archives. The output of cpio and tar is too hard to control properly and tend to vary over time. (Closes: #808809) * Ensure files extracted from a squashfs image are deleted after being compared instead being done examining the image. -- Jérémy Bobbio Mon, 04 Jan 2016 16:24:50 +0100 diffoscope (44) unstable; urgency=medium [ Mike Hommey ] * Tell readelf to use wide output. (Closes: #808103) * Add support for Mozilla optimized Zip files. (Closes: #808002) * Use and in HTML output. * Fix line numbering in HTML diff output (Closes: #808199) [ Jérémy Bobbio ] * Fix .deb comparisons when md5sums is wrong or missing. (Closes: #808104) * Remove some quadratic string concatenations in HTML presenter. * Remove useless s in HTML output. (Closes: #808121) * Replace calling find by using os.walk in directory comparator. * Sort the file list in directory comparator. (Closes: #808003) * Ensure the 'lines skipped' message gets written when lines are skipped at the end of a diff. * Make sure to read HTML reports as utf-8 in tests. [ Esa Peuha ] * Convert HTML character entity references to UTF-8 characters to save space. -- Jérémy Bobbio Fri, 18 Dec 2015 15:42:20 +0000 diffoscope (43) unstable; urgency=low [ Reiner Herrmann ] * Add comparator for Android dex files. * Add comparator for filesystem images using libguestfs. [ Chris Lamb ] * Add comparator for icons and JPEG images using libcaca. [ Clemens Lang ] * Add comparator for OS X binary files (also known as Mach-O). Requires the otool(1) and lipo(1) which are mostly likely found on OS X. [ Baptiste Daroussin ] * Use libarchive for tar instead of Python included library. We already have libarchive as a mandatory dependency, and libarchive is faster and more reliable. [ Mike McQuaid ] * Support older versions of GNU diff. OS X 10.11 ships with an older GPLv2 version (`2.8.1`) which does not support the `diff -u7` flag but instead wants to use `diff -U7` which appears to be forward compatible. [ Ed Maste ] * Use more portable LC_CTYPE suggestion. The C.UTF-8 locale is a Debian thing. [ Levente Polyak ] * Force ppudump to output time in UTC using the TZ variable. Support for the TZ environment variable has been implemented in fpc r32369. * Make PPU comparator version aware by checking the magic version expected by ppudump itself. [ Joachim Breitner ] * Add support for multi-file HTML output with on-demand loading of long diffs. This is available through the --html-dir option. Location of the jQuery JavaScript library can be specified through the --jquery option. (Closes: #806891) [ Jérémy Bobbio ] * Return the target path as string when extracting from a Zip. Regression introduced in diffoscope 41. (Closes: #805774) * Use pass_fds from Popen instead of reimplementing it. Thanks Baptiste Daroussin for the tip. * Fix typo in debug message. Thanks Clemens Lang! * Benefit from dictionary keys() behaving as set when comparing md5sums. * Prevent overwriting the destination when extracting with libarchive. Thanks Baptiste Daroussin noticing and initial implementation. * Fix PPU detection and associated tests. * Use lazy extraction instead of explicit bracketing. We now rely on Python garbage collector to delete file once we are done comparing. This will make parallel processing easier to implement. * Make container class available on demand instead of bracketing. This cleanups boilerplate code, and should make parallel processing easier to implement. * Always compare container content if applicable. This removes more boilerplate code. * Call xxd like other commands. * Analyze md5sums file in .deb before working on data.tar. This makes the code more robust and is required to properly skip files listed as identical in md5sums while doing parallel processing. * Add support for package names for OS other than Debian. The --list-tools command-line option now supports an optional argument to display a given operating system. When --list-tools is called without an optional argument and the current operating system is unknown, the list of packages for all known operating systems will be displayed. Initial implementation by Mattia Rizzolo, then greatly enhanced by Levente Polyak. * Update list of contributors. * Add contact info to README. * Add python3-guestfs to the list of Recommends. * Display a better error message when guestfs can't be started. * Set libguestfs memory allocation to 128 MiB in autopkgtest as more is likely to fail with adt-virt-qemu default settings. * Prevent CBFS comparator from scanning big files needlessly. Thanks Mike Hommey for the detailed bug report and suggestions. (Closes: #807997) -- Jérémy Bobbio Tue, 15 Dec 2015 15:54:55 +0000 diffoscope (42) unstable; urgency=medium * Add missing Depends on python3-pkg-resources. * Add another autopkgtest to test command line without recommends. * Make comparison of zip archives with utf-8 file names more robust. (Closes: #805418) * Stop crashing on misencoded readelf output. (Closes: #804061) * Ignore encoding errors in diff output. * Add binutils-multiarch to Build-Depends so the test suite can pass on architectures other than amd64. -- Jérémy Bobbio Fri, 20 Nov 2015 18:57:54 +0000 diffoscope (41) unstable; urgency=low * Minor rewordings in README. * Fix link in README. Thanks anthraxx. * Also skip tests when very common tools are unavailable. * Add git-buildpackage configuration in the hope it will help to get proper source tarball. * Allow commands to be called with specified environment variables. * Force ppudump to output time in UTC by setting TZDIR in the environment. -- Jérémy Bobbio Sat, 14 Nov 2015 14:23:09 +0100 diffoscope (40) unstable; urgency=low * Add missing files in PyPI package. * Use libarchive instead of debian.arfile to extract .deb. * Make python-debian optional. This will help packaging diffoscope in other distributions. * Add 'Programming Language' to PyPI classifiers. -- Jérémy Bobbio Fri, 13 Nov 2015 12:03:16 +0100 diffoscope (39) unstable; urgency=low [ Reiner Herrmann ] * Fix EPUB detection. [ Paul Gevers ] * Add diffoscope support for PPU files. [ Jérémy Bobbio ] * Split lines when they are recorded comments instead of waiting for the presenters to do it. This helps when there are multiple lines on stderr output. * Switch homepage URL to HTTPS. Thanks to Let's Encrypt! * Remove some Python 2 specific code in diffoscope.changes and diffoscope.comparators.__init__. * Make the tlsh module optional. python3-tlsh is now listed in Recommends. * Make file detection compatible with the pyhon-magic module available on PyPI. * Fix fallback code used when rpm module is unavailable. python3-rpm is now listed in Recommends. * Convert README to reStructuredText and update it. * Improve setup.py: - Fix the non-working PyTest class. - Update homepage URL. - Improve short description. - Add license field. - Update install_requires. * Update Build-Depends and Depends. * Also run the test suite without Recommends installed in autopkgtest. * Properly skip tests that requires external tools when they are not available. -- Jérémy Bobbio Thu, 12 Nov 2015 12:28:05 +0100 diffoscope (38) unstable; urgency=medium * Fix dh_python3 package overrides so we get a correct versioned Depends on python3-tlsh. -- Jérémy Bobbio Sat, 17 Oct 2015 11:05:12 +0200 diffoscope (37) unstable; urgency=low * Switch to incremental interface for TLSH. That means we won't load 800 MiB or more in memory to compute the fuzzy hash. * Add support for CBFS images (Closes: #788364) * Add support for .dsc files (Closes: #800359) * Fix handling of malformed md5sums file. (Closes: #799901) * Fix placeholder encoding issue when trimming stderr. (Closes: #799863) * Read text report as UTF-8 encoded in test_text_option_with_file. (Closes: #801766) * Read Haskell interfaces in binary mode (Closes: #801333) * Read md5sums file using UTF-8. * Add a test for --max-diff-block-lines. * Handle closing stdin for Command implementing feed_stdin. * Handle subprocess errors with no output when comparing with a command. * Use name and not path when doing binary comparisons. * Add a test for --list-tools. * Fix main exception handling. * Use text file comparison for .dsc and .changes when the referenced files are missing. * Do skip squashfs test if there's no user with uid 1000. * Use super() instead of the old cumbersome form. -- Jérémy Bobbio Thu, 15 Oct 2015 16:45:55 +0200 diffoscope (36) unstable; urgency=low * Read Debian .changes file as utf-8 encoded. * Add missing encode() for the 'too much input for diff' message. -- Jérémy Bobbio Tue, 22 Sep 2015 11:24:37 +0200 diffoscope (35) unstable; urgency=low [ Jérémy Bobbio ] * Switch to Python 3. This means code has been changed slightly here and there. Issues related to text encoding should now be far less frequent. According to some preliminary benchmark, diffoscope should run faster as well. * The system tar is now used instead of the Python module to display Tar archive metadata. The output should be slightly more accurate. * Log exceptions raised while computing diffs as errors * Avoid concatenating many strings in hexdump_fallback. This matters when looking at big binary files with xxd unavailable. * Let's ignore command errors when the file content is identical. * Fix isoinfo arguments to read Joliet data on ISO9660 images. * Ignore errors when reading Joliet and Rockridge data in ISO9660 images. * Use threads instead of processes for multiprocessing when running diff. There is no measurable performance impact and it helps to simplify the code. * Use the right argument order when creating CalledProcessError. * Propagate failure of external commands feeding diff. * Improve debugging log for command lines and exit codes. * Remove she-bang from files not meant to be executed directly. * Add more tests for main() behavior. * Improve RPM header conversion. * Fix a refactoring error in compare_commented_files(). [ Mattia Rizzolo ] * Drop X-Python-Version field, not needed anymore for python3. -- Jérémy Bobbio Mon, 21 Sep 2015 21:23:56 +0000 diffoscope (34) unstable; urgency=medium * Fix path to executable in README. Thanks Niko Tyni for the patch. * Encode file path when filtering it from readelf output. This fixes diffoscope for gnome-clocks. (Closes: #798398) * Include ELF test files in the source tarball. * Fix required tool for zip tests. * Fix expected `unsquashfs -s` output for squashfs-tools 4.3. * Parse md5sums in .deb even if they are identical. * Log ignore files count when comparing data.tar in .deb. * Minor code improvemnts. -- Jérémy Bobbio Thu, 17 Sep 2015 12:57:26 +0200 diffoscope (33) unstable; urgency=medium * Fix path to diffoscope used to generate Recommends. (Closes: #797978) -- Jérémy Bobbio Fri, 04 Sep 2015 10:20:45 +0200 diffoscope (32) unstable; urgency=medium [ Jérémy Bobbio ] * Add `--fuzzy-threshold` option. This allows one to specify the TLSH score used as cut-off for fuzzy matching. Specifying 0 will disable fuzzy-matching entirely. Thanks Jakub Wilk for prompting me to implement this. (Closes: #797557) * Add `--new-file` to treat absent files as empty. Thanks Jakub Wilk for the suggestion. (Closes: #797560) * Enable comparisons of symlinks and devices given on the command line. (Closes: #796262) * Fix comparisons of device files. (Closes: #796288) * Perform comparisons of file metadata in directories using original path. (Closes: #796202) * Display default values in `--help`. * Stop unpacking Tar directories. Thanks h01ger for the report. (Closes: #797164) * Make directory comparison work again. * Fix and document required Python modules. Thanks plntyk for the feedback on IRC. * Pass `--force-local`. to cpio. We don't want filenames with ':' to trigger remote copies. * Mark that get_ar_content() as requiring the 'ar' executable. * Rework how diffoscope main() is run. Thanks Yaroslav Halchenko for the report and suggestions. (Closes: #796196) * Assume UTF-8 output if stdin does not advertise any encoding. * Give proper error message when run on non-existing files. * Output differences in directory test to ease debugging. * Update manpage. Thanks Jakub Wilk for reporting the issue. (Closes: #797561) * Properly handle SIGTERM and do cleanup temp files. Thanks Mattia Rizzolo for reporting this and how he did work around this deficiency. (Closes: #788568) * Fix handling of GHC .hi file (Closes: #796039) * Add a test on how Ctrl+C is handled. * Minor code improvements. [ Chris Lamb ] * Correct "comment" on Device comparator. -- Jérémy Bobbio Thu, 03 Sep 2015 20:00:45 +0200 diffoscope (31) unstable; urgency=low [ Reiner Herrman ] * Fix detection of jar archives. * Make some hardcoded limits configurable. (Closes: #795292) [ Mattia Rizzolo ] * Don't print the traceback when killed by KeyboardInterrupt. * Add a --debugger option to dump the user into pdb in case of crashes. (Closes: #796204) [ Jérémy Bobbio ] * Replace ssdeep by tlsh [ Chris Lamb ] * Unify to 4 spaces everywhere. * Leave string interpolation to logging.$level(..) calls. * Add missing 'sys' import. * Specify source of 'Files' correct; was using "Changes" leaked from for loop. * Remove unused and duplicate imports. * Support passing directories as "foo/" or "foo". -- Jérémy Bobbio Fri, 21 Aug 2015 00:03:11 +0200 diffoscope (30) unstable; urgency=low * Remove empty line at the beginning of HTML reports. * Stop failing to run the tests when uid 1000 doesn't exist. * Make .changes file matching more accurate. * Move the sanity check for version number from clean to build rule. * Remove leftover debug in squashfs comparator. * Stop decompressing squashfs directories as we compare content already. -- Jérémy Bobbio Sun, 09 Aug 2015 12:18:30 +0200 diffoscope (29) unstable; urgency=low [ Reiner Herrmann ] * Prevent empty line at the end of squashfs listing. [ Jérémy Bobbio ] * Rename to diffoscope. debbindiff has grown way beyond a being just a tool to compare Debian packages. Let's rename it to better reflect this state of things. * Add a favicon to HTML reports. * Always use pybuild in debian/rules. -- Jérémy Bobbio Mon, 03 Aug 2015 15:55:07 +0200 debbindiff (28) unstable; urgency=low * Improve code quality by storing comments for Difference as lists. * Fix label for content of gzip, bzip2, and xz files. * Handle when only the encoding is different when comparing text files. (Closes: #794347) -- Jérémy Bobbio Sun, 02 Aug 2015 17:21:52 +0200 debbindiff (27) unstable; urgency=low [ Reiner Herrmann ] * Add dh-python to Build-Depends. [ Daniel Kahn Gillmor ] * Add support for Mono PE executables. [ Holger Levsen ] * Add myself to Uploaders. [ Jérémy Bobbio ] * Add tests for tar comparator. * Massive rearchitecturing. * Now use libarchive to handle cpio archives and iso9660 images. * find is now used to compare directory listings. * Symlinks and devices can now be properly compared. (Closes: #789003) * Files in squashfs are now extracted one by one. * Text files are now compared after being decoded with the detected encoding. Encoding differences are reported. (Closes: #785777) * Pre-compile regexps for ELF archives to get a good performance gain when comparing ELF objects. * Display better stacktrace for functions and methods using decorators. * Reset locale environment during tests. * Use numeric uid/gid when listing cpio content. * Set timezone to UTC when configuring locale. * Return no differences when there's none even when a required tool is unavailable. * Fix rpm expected listing after cpio change. * Skip tests when required tools are missing. * Skip squashfs listing test until #794096 is solved. * Analyze md5sums in .deb and skip identical files. * Add support for sqlite3 databases. * Implement fuzzy-matching of files in the same container using ssdeep. * Add pydist-overrides for magic and rpm. * When comparing .changes, match names without version numbers. * Switch to pybuild as dh buildsystem. -- Jérémy Bobbio Fri, 31 Jul 2015 08:38:10 +0000 debbindiff (26) unstable; urgency=low * Declare the package autopkgtestable. * Fix comparator for unknown files. * Add tests for unknown files comparator. -- Jérémy Bobbio Sun, 28 Jun 2015 09:22:21 +0000 debbindiff (25) unstable; urgency=low * Comparators now have a test suite with 93% code coverage. * Support autopkgtest to run the test suite. * Properly strip path from javap output even when they are relative. * Also remove 'Last modified' and 'MD5 checksum' lines from javap output. * Factorize readelf commands. * Filter archive name from readelf output. * Filter archive name from objdump output. * Fix charset handling of .mo files. * Don't be quadratic when parsing .mo header. * Skip archive name in zipinfo output. * Fix destination path when decompressing gzip files not ending in .gz. * Filter image name from squashfs superblock information. * Fix comparison of files in cpio archives. * Change how we handle a missing RPM module. * Don't add empty Difference when comparing files with equal metadata in directories. * Filter access time from stat output. * Rename .changes comparator. * Rework .changes comparator. * Comparators now return a single Difference instead of a list of Difference. -- Jérémy Bobbio Sat, 27 Jun 2015 14:32:58 +0000 debbindiff (24) unstable; urgency=medium * Fix for undefined variables introduced in last release. -- Reiner Herrmann Tue, 23 Jun 2015 00:15:28 +0200 debbindiff (23) unstable; urgency=medium [ Helmut Grohne ] * Speed up diff collection. * Read lines in larger chunks. [ Reiner Herrmann ] * Don't follow symlinks, but print their targets. -- Reiner Herrmann Mon, 22 Jun 2015 23:19:17 +0200 debbindiff (22) unstable; urgency=low * Add myself to uploaders * Swap JDK dependencies, so openjdk is preferred (thanks mapreri) -- Reiner Herrmann Sun, 14 Jun 2015 23:05:49 +0200 debbindiff (21) unstable; urgency=low * Non-maintainer upload. * Add support for Java .class files. * Add support for .ipk package files. -- Reiner Herrmann Sat, 13 Jun 2015 21:38:20 +0200 debbindiff (20) unstable; urgency=low [ Reiner Herrmann ] * info files can contain numbers in the extension [ Jérémy Bobbio ] * Fix diff parser when skipping until the end of a file without a newline. * Use same encoding as stdin when output is not a TTY. (Closes: #785288) -- Jérémy Bobbio Sun, 17 May 2015 16:05:14 +0200 debbindiff (19) unstable; urgency=low [ Reiner Herrmann ] * Fix info files comparator by specifying the correct parameter name for the text comparator. (Closes: #784891) -- Jérémy Bobbio Tue, 12 May 2015 10:35:48 +0200 debbindiff (18) unstable; urgency=low [ Reiner Herrmann ] * Use zip comparator for pk3 files. * Use text comparator for info files. * Drop mime type for info files. * Remove limit of diff output again. [ Jérémy Bobbio ] * Assume tar member names are UTF-8 encoded. This allows debbindiff to process drmips. * Write a text report on stdout as default behavior. * Allow both --html and --text to produce output in one run. -- Jérémy Bobbio Sat, 09 May 2015 11:29:46 +0200 debbindiff (17) unstable; urgency=low [ Jérémy Bobbio ] * Add support for ISO9660 images. * Catch a few more initrds as such. * Reimplement are_same_binaries() using cmp. [ Reiner Herrmann ] * Use gzip comparator for .dz (dictzip) files. * Added isoinfo to list of tool providers. [ Yasushi SHOJI ] * Disable 'Device' section diff in stat output. (Closes: #783792) -- Jérémy Bobbio Thu, 30 Apr 2015 19:29:26 +0200 debbindiff (16) unstable; urgency=low [ Reiner Herrmann ] * Remove temporary directory when exception is raised. (Closes: #782253) * Fix extraction when Zip member contain "../" in their path. [ Jérémy Bobbio ] * Fail with a better error message when unable to create a Queue. (Closes: #782551) -- Jérémy Bobbio Thu, 16 Apr 2015 11:07:58 +0200 debbindiff (15) unstable; urgency=low * Terminate xxd if its output was too long. * Handle broken zip files by falling back on binary comparison. * Fix an over-matching jar/war filename regexp. * Fix .hi comparator. * Fix some file descriptor leaks. -- Jérémy Bobbio Sat, 04 Apr 2015 18:30:48 +0200 debbindiff (14) unstable; urgency=low * Remove diffutils from Recommends as it is Essential:yes. * Fallback to Python hexlify if xxd is not available. * Decode msgunfmt output using the actual PO charset. * Stop buffering output of most external commands and send it to diff as it comes. (Closes: #781373) * Stop feeding input to diff after a certain amount of lines, as GNU diff cannot cope with arbitrary large output. * Fix newline and tab handling in HTML presenter. -- Jérémy Bobbio Thu, 02 Apr 2015 16:16:59 +0200 debbindiff (13) unstable; urgency=low [ Helmut Grohne ] * Fix several imports for RequiredToolNotFound. [ Jérémy Bobbio ] * Remove dead code from HTML presenter. * Fix tab handling in HTML presenter. * Swallow stderr when running showttf. (Closes: #781374) * Swallow stderr for readelf and objdump. * Use pipes instead of temp files to feed diff. * Stop processing diff output after too many lines. * Use LINESIZE constant directly in HTML presenter. * Better handle non-printable characters in HTML presenter. * Cut long lines in HTML presenter. -- Jérémy Bobbio Sat, 28 Mar 2015 18:53:29 +0100 debbindiff (12) unstable; urgency=low [ Helmut Grohne ] * Attempt at fixing unicode issues with --text. (Closes: #778641) [ Jérémy Bobbio ] * Try with utf-8 encoding when comparing text files and no common encoding has been detected. * Perform content comparison when finding differences instead of waiting for the presentation phases. (Closes: #781280) * Instead of using vim, the HTML view is created from diff output. (Closes: #772029, #779476) -- Jérémy Bobbio Fri, 27 Mar 2015 18:42:26 +0100 debbindiff (11) unstable; urgency=low * Use latin-1 to decode showttf output. * Normalize locale environment variables on startup and subsequently use UTF-8 to decode output of most external tools. (Closes: #780863) * Error out when encoding is not Unicode-compatible for text output. (Closes: #778641) -- Jérémy Bobbio Mon, 23 Mar 2015 22:00:15 +0100 debbindiff (10) unstable; urgency=low [ Chris Lamb ] * SVGZ files are gzip files. * Use gzip comparator for .tgz files. [ Reiner Herrmann ] * Use zip comparator for Java web archives (.war). * Use zip comparator for epub files. * Don't fill up diffs with dots. * Add support for squashfs images. [ Jérémy Bobbio ] * Output a nicer name for sub-directories. * Also compare stat, acl, and xattrs when comparing directories. * Check for availability of tools required by comparators (original work by Reiner Herrmann). Most packages in Depends are now in Recommends. * Ask objdump to display more sections. * Drop stderr output when running cpio -t. * Attempt to sort out multiple decoding and encoding issues. (Closes: #778641) * Fix source path when handling gzip, bzip2 and xz. (Closes: #779474) * Don't crash when two .changes don't contain the same files. (Closes: #779391) * Properly split lines when comparing .changes. * Add newlines if needed in text output. * Remove most table borders in HTML output. (Closes: #779475) * Properly close in HTML output. * Add anchors in HTML output. (Closes: #778537) * Update debian/copyright. -- Jérémy Bobbio Fri, 20 Mar 2015 13:52:44 +0100 debbindiff (9) unstable; urgency=medium [ Chris Lamb ] * Add rpm-common to Build-Depends so that we can “import rpm" during build. * Code improvements improvements. [ Jérémy Bobbio ] * Add plain text output for differences. Thanks Helmut Grohne for the original patch. (Closes: #778423) * Exit with 2 in case of errors. (Closes: #774983) * Properly output diffs when one of the file is empty. * Add support for comparing directories. * Update debian/copyright. -- Jérémy Bobbio Sun, 15 Feb 2015 12:13:46 +0100 debbindiff (8) unstable; urgency=medium [ Peter De Wachter ] * Use `diff -a` so debbindiff doesn't abort on binary files. [ Jérémy Bobbio ] * Verify that version in debian/changelog matches debbindiff version. * Update debian/copyright. * Recognize text/plain files. [ Reiner Herrmann ] * Increased line context of diff to further lower running time. * Use text comparator for xml/xhtml files. * Use text comparator for postscript files. * Add support for cpio archives. * Add support for rpm packages. * Fix a typo in debbindiff name in source headers. [ Chris Lamb ] * Improve code quality in several places. -- Jérémy Bobbio Tue, 10 Feb 2015 03:02:55 +0100 debbindiff (7) unstable; urgency=medium [ Jérémy Bobbio ] * Add support for PDF files. * Add --max-report-size command-line option. * Add extra mime type for .deb. * Fallback on binary comparison when external tools fail. (Closes: #764140) * Update copyrights. [ Helmut Grohne ] * Avoid unnecessary guess_mime_type calls. [ Reiner Herrmann ] * Speed up creation of diffs by removing extra lines before calling vim. -- Jérémy Bobbio Sat, 10 Jan 2015 14:05:17 +0100 debbindiff (6) unstable; urgency=medium * Fallback to binary comparison when text encoding gets misdetected. * Skip full comparison when small files match. -- Jérémy Bobbio Wed, 07 Jan 2015 12:01:11 +0100 debbindiff (5) unstable; urgency=medium * Properly encode strings before writing them to tempfiles. (Closes: #764254) * Fallback on binary comparison when text encoding is unknown. * Always use given source path in binary_fallback. * Add support for .udeb. * Add support for ttf and otf files. * Add support for png files. (Closes: #773573) -- Jérémy Bobbio Tue, 30 Dec 2014 12:34:13 +0100 debbindiff (4) unstable; urgency=medium * Look harder for differences in zip files if needed. * Avoid deadlock when calling vimdiff. (Closes: #764131, #764420) * Add support for an external CSS. (Closes: #764470) * Improve default CSS to keep tables from overflowing. * Bump Standards-Version. -- Jérémy Bobbio Sun, 09 Nov 2014 12:35:07 +0100 debbindiff (3) unstable; urgency=low * Initial Debian release. (Closes: #763328) -- Jérémy Bobbio Thu, 02 Oct 2014 13:52:55 +0200