Most existing path following algorithms for middle or large-sized underwater vehicles minimize yaw difference of the control object. Breaking the canonical manner, this paper presents a vision-based path planning and following system for miniature robotic fish. As for path planning, the proposed system finds a gird path based on the AStar algorithm and selects a series of target points in the grid path. By connecting these points in order, a curve path can be planned. In terms of path following, the proposed system forgoes to give a specific yaw and only uses a global camera. It obtains coordinates of the robotic fish in real time by KCF tracking algorithm to calculate an approximate motion vector. A PID controller is employed to drive the difference angle between the motion vector and the target vector (the vector from the robotic fish to the target point) to zero. By swimming to target points one by one, the robotic fish can move to the terminus following the planned path. Finally, aquatic experiments are conducted to verify the effectiveness of the vision-based path planning and following system. The results reveal that the developed system can generate a safe and smooth path, and the robotic fish can follow the path with acceptable deviation.