Just realize that z-index only works on non-static element. May be I knew it before but didn’t really make it a knowledge.
When using tab to focus between links, we can use outline to style the focus outline and make it clearer. But element next to the focused link can block the outline. The key point here is to make the :focus element a non-static position, such as relative.