Rabbit Hemorrhagic disease virus (RHDV), a calicivirus of the Lagovirus genus, and responsible for rabbit hemorrhagic disease (RHD), kills rabbits between 48 to 72 hours post infection with mortality rates as high as 50–90%. Caliciviruses, including noroviruses and RHDV, have been shown to bind histo-blood group antigens (HBGA) and human non-secretor individuals lacking ABH antigens in epithelia have been found to be resistant to norovirus infection. RHDV virus-like particles have previously been shown to bind the H type 2 and A antigens. In this study we present a comprehensive assessment of the strain-specific binding patterns of different RHDV isolates to HBGAs. We characterized the HBGA expression in the duodenum of wild and domestic rabbits by mass spectrometry and relative quantification of A, B and H type 2 expression. A detailed binding analysis of a range of RHDV strains, to synthetic sugars and human red blood cells, as well as to rabbit duodenum, a likely gastrointestinal site for viral entrance was performed. Enzymatic cleavage of HBGA epitopes confirmed binding specificity. Binding was observed to blood group B, A and H type 2 epitopes in a strain-dependent manner with slight differences in specificity for A, B or H epitopes allowing RHDV strains to preferentially recognize different subgroups of animals. Strains related to the earliest described RHDV outbreak were not able to bind A, whereas all other genotypes have acquired A binding. In an experimental infection study, rabbits lacking the correct HBGA ligands were resistant to lethal RHDV infection at low challenge doses. Similarly, survivors of outbreaks in wild populations showed increased frequency of weak binding phenotypes, indicating selection for host resistance depending on the strain circulating in the population. HBGAs thus act as attachment factors facilitating infection, while their polymorphism of expression could contribute to generate genetic resistance to RHDV at the population level.