In multiphon interference processes, the commonly assumed direct link between boson bunching and particle indistinguishability has recently been challenged in Seron et al. [Nat. Photon. 17, 702 (2023)]. Exploiting the connection between optical interferometry and matrix permanents, it appeared that bunching effects may surprisingly be enhanced in some interferometers by preparing specific states of partially distinguishable photons. Interestingly, all the states giving rise to such an anomalous bunching were found to be far from the state of perfectly indistinguishable particles, raising the question of whether this intriguing phenomenon might even exist for nearly indistinguishable particles. Here, we answer positively this physically motivated question by exploiting some mathematical conjecture on matrix permanents, whose physical interpretation had not yet been unveiled. Using a recently found counterexample to this conjecture, we demonstrate that there is an optical set-up involving 8~photons in 10~modes for which the probability that all photons bunch into two output modes can be enhanced by applying a suitable perturbation to the polarization states starting from photons with the same polarization. We also find out that the perturbation that decreases the bunching probability the most is not the one that takes the perfectly indistinguishable state towards a fully distinguishable state, as could naively be expected.