2016-12-05

- The uploaders have now also switched to the new and improved syncing system, so let us know if you spot any missing thumbnails or images on new uploads.


2016-12-03

- Corrected another edge case where the image resamplers could get confused by bad image geometry.


2016-12-01

- Corrected an issue with the update on 2016-11-27 that broke PM emails for people in some member groups.

- Added improved replay protection to the 1.3+ H@H RPC. This should prevent intrusive web scanners that monitor local network traffic and transmit all requested URLs to a remote server in order to re-request the same URLs remotely from interfering with H@H. (I'm looking at you, Trend Micro.)

Note that this will not be backported to 1.2, so if you are having the FAIL_NOT_LOGGED_IN issue caused by this scanning behavior, you should upgrade to 1.4.0. Alternatively, get rid of the intrusive scanner.

PS: Apparently this is a function built in to some recent Asus routers, ostensibly to "prevent devices from communicating personal information to external parties", and should probably be disabled from the Network Protection screen if you don't want your router to send a near-realtime list of all sites you visit to an external party.


2016-11-30

- Various tweaks to the bounty screen, mostly to increase the amount of space for the bounty description text.

- Properly formatted links to E-Hentai and a handful of other approved sites will now be automatically linkified in the bounty description text and bounty claim texts.


2016-11-28

- The repo servers that handle torrents and bounty images have been changed over to a new and more efficient way to synchronize files. Let us know if you spot any missing torrents or bounty images.


2016-11-27

- The forum will no longer email PM notifications to people who have been inactive for more than a month.


2016-11-26

There were a couple of situations where a tag for a gallery could end up in a semi-inconsistent state where it was both active and vetoed. This could happen if someone who had previously downvoted a tag was added as a vetoer and that happened to bring the number of veto votes from two to three, or if a vetoer outside of the three that did the vetoing voted the tag up after it was vetoed. This should now be fixed in the following ways:

- If an active tag is retroactively vetoed by a vetoer assignment rather than a vote, and someone votes for the tag, it will be properly cleared as if it were vetoed instead of returning an error.

- If a vetoer upvotes a tag that was previously vetoed, the existing vetoes will be cleared.


2016-11-22

- Corrected some unnecessary HTML code escaping for directory names when using the H@H downloader.


2016-11-18

- Corrected a bug with the uploader archive processor where files that had filenames containing certain keywords could be rejected as corrupted. (Uploading them normally would work just fine.)


2016-11-17

- Corrected some cases where the link to switch between list and thumbnail mode had an invalid URL.


2016-11-13

- The H@H static range assignment algorithm will now avoid assigning a range to multiple clients run by the same member in the same region. This will reduce overlap and avoid having those clients compete for the same traffic, thus making better use of those resources.


2016-11-12

- Corrected an issue where a cookie wasn't made persistent, which could make ads appear on the first pageload for donators after restarting the browser. (This might not take effect until the next time the cookie is cleared by a restart.)


2016-11-09

- The option to use a H@H client as a local image proxy has now been removed, as the 1.3 branch and future versions of H@H no longer supports it.

- Minor improvements to how the user setting cookie is managed. Mostly visibly, the option for disabling ads is now always enabled for donators, and will no longer show up under the settings.

Update: Fixed an issue where toggles outside of the My Settings page (like the one for switching display mode) didn't work if all your settings were on default or you just reset your cookies.


2016-11-04

- The Soul Catcher perk will now add the fragments automatically once per day instead of doing it with the dawn event, assuming that you have opened HV at least once during the last 30 days.


2016-10-12

- Corrected a server-side initialization issue that could prevent brand new H@H idents from doing first-time startup when using the experimental 1.3 branch.


2016-10-11

- The site will now automatically retry image load failures. Note that depending on the nature of the load failure, the exact time for this to kick in can depend on your browser's load timeout value. Therefore, we still have the "click if failed" button for impatient types.


2016-10-09

- Corrected a bug with the H@H Downloader where the effective horizontal resolution for the gallery could get wrongly calculated at one point, which could cause it to loop attempts at downloading the same gallery.


2016-10-02

- Corrected a permission issue with the H@H Downloader that prevented it from fetching uploader names if they weren't cached.

- The limit for largest allowed sell/buy count on the GP and Hath exchanges was increased from 20,000 to 100,000 Hath/kGP. Which means that you can now put up larger whale walls, or eat the entire exchange even faster than before.

- The hath reward for Adopt-a-Server slots has been recalculated, increasing it from 7 to 15 per day. (Adopt-a-Server slots are supposed to be roughly equivalent to running a client with a hitrate of 50, and the global average H@H client would currently get around 14.91 Hath/day with that rate.)


2016-10-01

- Added support for the H@H 1.3 Downloader.

- The old 1200x resamples have now finally been phased completely out, and fully replaced with the new resample system.


2016-09-30

- Corrected an issue where the file search similarity scan would fail to detect files it should normally find due to a problem with how some internal matrices were normalized.

- It also should no longer error out if too many matches were found.


2016-09-27

- More tweaks to the resamplers to let them better deal with large load spikes, preventing a cascading overload situation that could delay some image loads by 10-30 seconds.


2016-09-24

- Made some tweaks to the image dispatcher based on data gathered during today's downtime to improve reliability for H@H/image loads when operating in independent mode on the backup clusters.


2016-09-23

- Some PNG files with an alpha channel and non-standard geometry would end up as fully black when being flattened during resampling. The resamplers will now detect and avoid flattening these files.


2016-09-21

- After a bunch of backend restructuring, we now have a fully redundant resampling setup up and running. Let us know if you encounter any issues with resampled files after this update.


2016-09-15

- Corrected an issue where a bounty could go straight from active to expired (bypassing the warning) if the most recent grant was withdrawn and the next most recent grant was more than a month old. To prevent this, every bounty now tracks its expiry progress with a separate flag.

Note that a side-effect of this is that bounties that were less than 7 days from expiring have been reset to expire in 7 days.


2016-09-07

- Corrected an issue where on-demand H@H image requests would touch the timer on the resource usage counter for the IP in question, which could prevent them from regenerating. (This didn't significantly affect it unless the client was large enough to send these requests more frequently than the resolution on the regeneration timer.)


2016-08-28

- Corrected an issue where a short-duration suspension and resuming of a H@H client could reset its timer for the archiver quota. This now uses the exact same rules as stopping and restarting a client.

- The restart/resume grace period was increased from one hour to four hours.

- Two readouts were added to the H@H regional stats:

Hitrate/GB shows the average hitrate per gigabyte of allocated disk space for all clients in the region, measured over the last 24 hours. This is a strong indicator for where new H@H deployments would get the most bang for their bucks.

Quality shows the current average quality for all clients in the region. Because quality is corrected per client based on regional conditions, this shouldn't generally go significantly below 7000.

Both of these stats ignore clients that are offline, suspended, or currently untrusted.


2016-08-22

- If you select Japanese Title under the Gallery Name Display selector, this will now also be used for the Archiver.


2016-08-21

- The Resample Resolution selector can now be used in conjunction with the Original Images setting. (PS: This wasn't pushed live, should be active now.)

If Original Images is enabled and Resample Resolution is set at anything except for Auto, the system will now use the original file for all images where the original is equal to or less than the chosen resolution, and the appropriate resampled file if the original resolution is higher than the selected resample resolution.

Leaving the Resample Resolution at Auto is equivalent to the old functionality, where the original file would be used regardless of this setting.


2016-08-20

- Resamples with transparent backgrounds are now flattened to avoid corrupted-looking backgrounds.


2016-08-19

- In the rare case where an original file doesn't have higher horizontal resolution than the requested one but still qualifies for a resample, and the resampled file ends up being larger than the original for whatever reason, the system will now discard the resample and stick to using the original.

- Previously, a H@H client had to have been running for at least 24 hours consecutively in order to qualify for the free archiver quota. A grace period has now been added where if the client had been running for more than 24 hours during the previous session, stopping the client and restarting it within one hour will no longer trigger a new cooldown.

(Note that if the quota is recalculated by using the archiver or visiting the H@H status page while the client is offline, you may have to wait another hour for it to be recalculated again.)


2016-08-18

- Fixed some toplist/gallery stat display issues, and applied some backend performance improvements.

- Adopt-a-Server slots now count as a standard H@H client with a hitrate of 50 towards the free archiver quota.


2016-08-17

- Corrected an issue where the estimated display resolution for a resampled file that was generated on demand as part of a page request (i.e. had not been viewed at that resolution before) could be significantly wrong if the source resolution was smaller than the set resample resolution, which would cause the image to be stretched.


2016-08-15

- Improved resampling scheduling/priority on the resampler to better handle temporary high-load situations.

- Fixed an issue on the resampler where zero-byte files would not be correctly detected and regenerated.


2016-08-14

- The algorithm to determine when it is and isn't worth it to resample an image at a chosen resolution is now somewhat more sophisticated. This will be tuned in over the next few days.

- Revised the donation archiver quotas to be more in line with H@H awards.

- Added a readout on the H@H page for the H@H archiver quota.


2016-08-08

- Corrected an issue with the archiver where filenames that started with a period would not be included in the archive. (This was an old bug, not introduced by the recent changes.)


2016-08-07

- The archiver is now also able to estimate the size of resampled archives, using the actual size of the files it would use if available and a rough estimate based on the original file if not.

- The cost for resample downloads is now based on the resample size estimate instead of being a fixed fraction of the original cost. In many cases, this means resample archives will be far cheaper than the original ones.


2016-08-05

- The archiver can now also be used to download the 1280 horizontal resolution resamples that are used by default on the site. Initially, this is limited to galleries that have 25% or more resampled files at this resolution.

- Resample archives currently "cost" a fixed 75% of the original archive, since the archiver is not currently able to estimate (or even guess roughly) how large the resampled archive will be. This may be changed in the future.

- Because of these changes, clicking on the Archive Download button for an archive you have previously unlocked will now take you to the archive selector instead of straight to the archive link, unless you have selected Auto Select Original or Auto Select Resample under My Settings.

- You can now see when an archive download was unlocked on the archive popup, as well as cancel an active session in case you somehow manage to burn through the archive's allowed number of downloads without successfully downloading it.

- Since the archiver is now capable of generating a download with resampled files, the H@H Downloader was retired. The addition of static ranges has made that suboptimal, and with resampled archives it also no longer has a unique function. Therefore, it has instead been replaced with a free archiver quota. (See below)

- The old free archiver downloads for donators was changed from a fixed number of archives to use a quota based on archiver size. This also allows us to use this system for people who run H@H, to replace the retired H@H Downloader system.

- For donators, each free archive from the old system now instead adds +50MB/day to the archiver quota. Tiers above gold were changed from +5 (250 MB/day) to +10 (500 MB/day) per tier.

- For people who run H@H, the archiver quota is now increased by +1000 MB/day for running at least one qualifying client, in addition to +10 MB/day per total adjusted avghit.

- H@H clients will only qualify if they have been running for more than 24 hours and have a hitrate of at least 1.

- Like the old system, the "daily" quota is measured over a 7-day window. You can spend up to 7 days worth of quota in a day, but you would obviously then have to wait a week for it to cool down.


2016-08-01

- Implemented some improvements to the EHTracker connection handling and backend stat tracking, which should significantly improve overall performance and reliability, especially when dealing with large spikes in the request rate.


2016-07-29

- The forum is now HTTPS only.


2016-07-28

- Fixed an issue limiting MPV availability when granted by the perk rather than a star.


2016-07-26

- More of the site now uses HTTPS only.


2016-07-16

- The system will now accept JPEGs up to 20MB and PNGs up to 50MB. Note that because of a limitation with the current H@H release, when browsing a gallery, source images over 10MB will currently use the 2400x resample if you have the "original images" toggle selected.

- Fixed an issue with rename votes where you could end up with multiple votes on the same gallery/script due to a weak check for existing votes.

- The broken H@H Local Network Host setting was reworked and readded as a per-user setting instead of a per-client setting. You can now find it under My Settings. This works by checking if your current browsing IP matches the H@H client that's servicing your request, and replaces the host with the one specified in this field if it is. (This is mostly useful to work around buggy routers that cannot route a request back to itself.)

- The max number of static ranges per H@H client was further increased to 5000.


2016-07-04

- Corrected an issue where invalid tags could be created with certain invalid input.


2016-07-03

- Corrected some buggy behavior for single-character wildcards. As a bonus, booru-style searches should now work about as well as native style.


2016-07-02

- The H@H "Local Network Host IP Address" setting was removed, as it hasn't had any actual effect for years.


2016-05-28

- Various improvements to the H@H static range assignments. The system now tracks an additional quality "low watermark" stat for each client, which is used to accelerate or slow the assignment rate depending on how well the client can handle it, and prevent clients that drop too low during peak hours from being assigned more work during low-traffic hours.


2016-05-23

- Fixed a display glitch on recently replaced galleries caused by a regression introduced by yesterday's cache changes.


2016-05-22

- Made some changes to how comments and comment votes are processed and cached to avoid breakage on galleries with many revisions.

- Minor fixes to the tag adding logic.


2016-05-21

- H@H quality calculations now take the average failure rate of the specific region into account. Over time, this should result in a small to moderate quality boost for clients outside of Europe. (Having the highest average, Europe was used as the baseline.)


2016-05-19

- The "server communication failed" error when browsing images should no longer happen if an AJAX request fails, instead an automatic reload should trigger.


2016-05-15

- Hard-capped the max number of gallery results that involve a search to 200,000 to avoid breaking on some search terms.


2016-04-14

- Actually fixed an issue that made forum sidebar information fail to update for people who didn't have a donation badge.


2016-04-13

- Fixed an issue that made forum sidebar information fail to update for people who didn't have a donation badge.


2016-04-11

- Corrected another favorite caching issue specific to the gallery page and the black favorite category.


2016-04-10

- The system will now always use RGB colorspace for thumbnails and resizes.


2016-04-07

- Fixed gallery image upload errors not being printed when doing "Upload and Add More" rather than "Upload and Continue".


2016-04-06

- Fixed colored rating stars not appearing on the favorite page when in thumbnail mode.


2016-04-02

- In the add/modify favorite popup box, clicking the selected favorite category or double-clicking a favorite category will now save and close the popup window.

- Fixed a bug where setting a gallery you had previously rated as a favorite could make the favorite timestamp not be set properly, and show up as the Unix epoch on the favorite screen.

Favorites that were missing a timestamp have been corrected to having been set today.


2016-04-01

- Various internal improvements on the uploader, particularly for archive handling. The hard limit for upload size was increased to 1 GB at a time.


2016-03-30

- Corrected some caching behavior for total and per-category favorite counts on the favorite screen.


2016-03-25

- Corrected a favorite/rating cache invalidation issue where galleries that were updated could show up as not rated/favorited even if they were.

- Fixed forum sidebar information not being forced to update when it was supposed to.


2016-03-24

- Restored missing thumbnail load setting for list mode.

- Corrected the cost for More Favorite Notes I.


2016-03-23

- Corrected favorite page pagination for the black category.

- Notes with corrupted character encoding will now be properly dropped instead of being set as an empty note that still took up a note slot.


2016-03-22

- The internal storage and caching for Favorites and Ratings has been fully revamped and combined in a way that allows us to significantly extent the functionality of both systems.

- The favorite limit has been partially eliminated. There is still a limit for how many notes you can store, but the number of actual favorites is no longer limited. Hath perks were changed to work on notes instead.

- When you rate a gallery, the average rating will now be replaced with your own color-coded rating everywhere it appears; that is, on the front/search page, the favorite page and the gallery page. The average rating will still be displayed below the stars on the gallery page.

- The color combinations for the rating indicators can now be customized on the settings page.

- Added a timestamp for when you favorited a gallery. You can now choose to sort favorites using this instead of the default ordering by last gallery update time.

- Added a toggle to use the Japanese gallery titles in most readouts that only display one title. If this option is selected and the gallery doesn't have one, it will use the English/Romaji title instead.

- Max daily toplist points for rating galleries was further reduced to 20/day. This might be phased out entirely.

- Favorite Screen: Search terms will now be retained when changing the displayed favorite group.

- Favorite Screen: The uploader username is no longer displayed when in List Mode. Instead, a new field was added for the time when the gallery was favorited.

- Favorite Screen: Added a toggle for List/Thumbnail Mode. This is still the global setting, which also affects the front/search page.

- Favorite Screen: Long gallery titles should no longer cause layout issues in List Mode.

- Gallery Screen: The gallery page favorite indicator will now use the name of the favorite category instead of the generic "Favorite Gallery" text. The actual icon itself is also now clickable.

- Gallery Screen: You can now re-rate a gallery without reloading the page.

- Front/Search/Favorite Screen: Updates will now be visible instantly when you modify a gallery's favorite category or favorite note.


2016-03-13

- Phase 5 rollout of the new resampled image system is now live.

This introduces the new 1600x and 2400x resampled image options for (eventually) all registered members. For capacity reasons, we have to do a staggered rollout of this feature. Read more in the New Feature Thread.

The resolution can be changed from My Settings. Eventually you'll also be able to change this from the image page directly.


2016-03-11

- Phase 4 rollout of the new resampled image system is now live.

New 1280x resamples are now handled by the new resampling system. This means that all resamples are now done on-demand, which among other things will speed up the process of adding files to galleries by a fair bit.

1280x resamples are now also consistently 1280x, unlike the old one that resampled to 1200x but was only applied for files larger than 1280x.

Over time, the older 1200x legacy resamples will be re-resampled as 1280x, so there's no need to reupload these.

Note that, as for 780x and 980x resamples, the very first time an image is requested the request will bypass any H@H image proxy. It will also not display the image file size, as this is unknown when the page is loaded.


2016-03-09

- A new master database + standby backup is now live. These are both based on a Xeon E5-1650 with 128 GB RAM and a 400GB Intel DC S3710 SSD.

- The second resample staging server is now active, in preparation for changing all resamples to on-demand.


2016-03-03

- Phase 3 rollout of the new resampled image system is now live.

This allows you to select lofi resample files in the normal Galleries system by selecting either 980x or 780x under My Settings.

1200px files will start to be merged into the new system, as soon as an ongoing file sync to new lofi image servers completes.


2016-02-23

- Phase 2 rollout of the new resampled image system is now live.

This adds H@H support for the 780x and 980x resampled files used for lofi. Lofi will now automatically use H@H as long as the requested file has been generated, and it hasn't been disabled.

A toggle was added to the bottom of the lofi site to easily disable H@H if necessary. This toggle is global and will mirror the one under My Settings, except that you don't have to log on to toggle it.

Note that lofi doesn't have a separate button to reload a H@H image if it should fail for whatever reason. It will automatically detect that the previous image load failed if you reload an image page, and force a load from the main image servers.

Lofi files will never be pre-distributed, as they only work with static ranges. If you run H@H, there is no client-side update necessary.

- Reworked parts of the H@H settings page, to update and add some information, as well as make some descriptions somewhat clearer.

- A readout for "Country" was added to the H@H screen. If this lists the wrong country for your client, you should poke me to have an override applied.


2016-02-20

- Tracker tests were successful, so we have updated the rest of the tracker nodes to the new software.


2016-02-19

- A network issue at our host that would cause slower than expected downloads of some archives appears to have been corrected.

- A couple of additional tracker nodes have been deployed, primarily to test a new software stack in high-load settings.


2016-02-18

- The second set of secondary image servers is now live. This concludes this round of image server upgrades, with a grand total of 10 new servers deployed.


2016-02-12

- The lofi resample functionality was switched over from a temporary VM to its permanent new home on one of the repurposed old upload servers.


2016-02-07

- Tags that are too weak to be searchable are now shown with a dotted border instead of a dashed one.

- The MPV will now automatically reinitialize to the current page if an AJAX error occurs or the keys have expired.

- Fixed a double-encoding issues on favorite page searches that could break pagination if certain characters (like quotes) were used in the search.


2016-02-06

- Put in some improvements to file search performance, including a long overdue maintenance script to remove files from the index if they cannot appear in a search result. Overall, this should improve search speed by a factor of 3-5x.

- Minor improvements to the image resampler to avoid triggering the race condition handler slowdown unnecessarily.


2016-02-04

- The new upload/primary image servers are now live.


2016-02-03

- Fixed an issue where H@H used an outdated format for the "load failure" indicator when retrying image downloads, which would cause the image dispatcher to ignore it and not force a retry from an image server, increasing the chance to fail the download multiple times. (This was fixed server-side rather than as a H@H update.)


2016-02-02

- A full set of new secondary image servers at a third host has now gone live. Some new logic for server selection and internal image distribution went live at the same time.


2016-01-30

In preparation for an upcoming upload server switchover, the bounty and torrent upload functionality as well as Atom feed generation and various other odds and ends was moved to a new set of servers.

As this is the first time we've deployed servers with this particular software stack, do let us know if you encounter any weirdness. (Mixed-content SSL warnings on the bounty post page are normal, for now.)


2016-01-26

- Switched source image downloads to the new server selection mechanism added in Phase 1.

- Switched to a new and more compact time limited token mechanism for lofi and source images. (Mostly relevant for third party scripts.)


2016-01-23

- Corrected a minor issue with the new resampler where the race condition handler would be triggered, causing a slowdown and failure to update the resample reference, if multiple files ended up with the exact same resampled file. (Which could happen for solid-color images.)

- Exact file search will now also look for lofi file resamples. (This was not possible before.)

- Corrected non-converging query usage for event state tables in case of logging server desyncs. (Which could cause multiple dawns when switching servers.)

- Changing a comment from "hidden" to "blocked" will now require either: a score of -50 excluding the gallery owner's vote, as well as a downvote from the owner, or; a score of -100, as well as a downvote from a tag vetoer. That is, without a downvote from either the gallery owner or a tag vetoer, it is no longer possible to block comments.


2016-01-22

- Fixed a potential issue with the PM URL limitation for new user accounts.


2016-01-21

- Phase 1 rollout of the new resampled image system is now live.

This consists of a fully revamped backend staging system, database storage structure and filesystem structure to enable future functionality.

Most relevant for now, on-demand image generation for lofi is much faster and more reliable, and some unnecessary resamples are avoided.

Note that as 460x resamples were only used for about 1% of all lofi image requests. Because of the lack of use, this option is no longer available.

- Revamped internal logging to avoid potential desyncs on the logging servers.

- Revamped the way internal server monitoring affects live server choices, to enable higher reliablity and availablity.

- Minor improvements to page selection linkification.

- Randomly generated strings (used for torrent keys, H@H keys and so on) now use the base-58 alphabet to avoid visually similar characters (O/0 and I/l)


2016-01-17

- Pre-recruit members can no longer use image links or named links in private messages. Plain links are still fine.


2016-01-13

- Fixed some bad interaction with the $ operator, uploader searches and display mode switching.


2016-01-06

- You can now put a $ at the end of a search term to force the search engine to treat it as a tag and do an exact search rather than searching all tags that start with the term. This works both with and without a namespace. (Compare: artist:yam to artist:yam$ and yam$)

Note that if searching for a tag with multiple words, quotes must be used - for example "females only$"

This also allows some previously impossible functionality, like searching for a title that doesn't have a tag featured in the title - for example, "females only" -"females only$"

- The search string generated when clicking "Show Tagged Galleries" on a gallery tag makes use of this new functionality to make searching consistent when hitting "Apply Filter" on the search pane, allowing you to add new search terms to the query without leaving tag search mode for the initial search term.

- Ratings from "excessively negative people" (see above) are again included with the rating count to prevent behavior that could seem glitchy. (Though, obviously, it's not factored into the computed average.)


2016-01-04

- Corrected a toplist issue where renames, comments and expunges were still using the old cutoff times for the yearly and monthly lists. The toplists themselves should be corrected on the next run right after midnight UTC.

- Rating cap was reduced to 50/day. Comment scores were tweaked to be less reliant on upvotes.

- The system is now much better at recognizing and subsequently disregarding excessively negative people.