Comment by kanishkalinux

Currently, it does not allow full spidering.