External Annotators are not appearing correctly when new lines are added or deleted

I have extended ExtanalAnnotator in my plugin, it works properly and gives the desired result but if new lines are added or deleted, from the changed line onward it won't display annotators correctly, Ex:annotators appears on wrong lines, multiple annotators appears on some lines

public void apply(@NotNull PsiFile file, List<Issue> issues, @NotNull AnnotationHolder holder) {
.......
.......

Annotation annotation = holder.createInfoAnnotation(psiElement, Text);
......

}