Kernel Threads Continued

<< Previous Article

In the previous article, we learned the basics of kernel threads such as creating the thread, running the thread and so on. In this article, we will dive a bit more into the kernel threads, where we will see the things such as stopping the thread, signalling the thread and so. So, let’s begin…

Continuing with the previous article, we were observing a crash while removing the kernel module with rmmod, So, are you able to find the reason for the crash? If yes, that’s very well done. The reason for the crash wasss … Let us first cover this article and hopefully, as a part of that, you by yourself would be able to discover the reason.

Stopping the Kernel Thread

If you are familiar with the pthreads in user space, you might have come across the call pthread_cancel(). With this call, one thread can send the cancellation request to the other. Pretty similar to this, there exists a call called kthread_stop() in kernel space. Below is the prototype for the same:

#include <linux/kthread.h>
int kthread_stop(struct task_struct *k);

Parameters:
k – pointer to the task structure of the thread to be stopped

Returns:  The result of the function executed by the thread, -EINTR, if wake_up_process() was never called.

Below is the code snippet which uses kthread_stop():

#include <linux/module.h>
#include <linux/kernel.h>
#include <linux/kthread.h>
#include <linux/delay.h>

static struct task_struct *thread_st;
// Function executed by kernel thread
static int thread_fn(void *unused)
{
    while (1)
    {
        printk(KERN_INFO "Thread Running\n");
        ssleep(5);
    }
    printk(KERN_INFO "Thread Stopping\n");
    do_exit(0);
    return 0;
}
// Module Initialization
static int __init init_thread(void)
{
    printk(KERN_INFO "Creating Thread\n");
    //Create the kernel thread with name 'mythread'
    thread_st = kthread_run(thread_fn, NULL, "mythread");
    if (thread_st)
        printk(KERN_INFO "Thread Created successfully\n");
    else
        printk(KERN_ERR "Thread creation failed\n");
    return 0;
}
// Module Exit
static void __exit cleanup_thread(void)
{
   printk(KERN_INFO "Cleaning Up\n");
   if (thread_st)
   {
       kthread_stop(thread_st);
       printk(KERN_INFO "Thread stopped");
   }
}
MODULE_LICENSE("GPL");
module_init(init_thread);
module_exit(cleanup_thread);

Compile the code and insert the module with insmod. Now, try removing the module with rmmod. What do you see? Dude … where is my command prompt? rmmod seems to have got stuck..”. Relax guys!  I forgot to mention that kthread_stop(), is indeed a blocking call. It waits for the thread to exit and since our thread is in while(1), so hopefully, it will never exit and unfortunately, our rmmod will never come out. So, what does this mean? What we can infer from this, is that the kthread_stop() is just the signal, not the command. Calling kthread_stop() doesn’t gives you a license to kill/stop the thread, instead it just sets the flag in the task_struct() of the thread and waits for the thread to exit. It’s totally upto the thread to decide, when it would like to exit.  So, why is such a thing? Well, just think of the scenario where kernel thread has allocated a memory and would free it up once it exits. Had it been allowed to be killed in middle, thread would never be able to free up the memory. This, in turn would result in memory leak. This was the one of the simplest scenarios, which I could think of. Coming back to our problem, how do we get back the command prompt? Let’s try one more thing. In the user space, you might have used the kill  command to send the signal to the process. And one of the most powerful signal which process can’t mask is SIGKILL. So, lets use the same on the kernel thread as well. Find the id of the running kernel thread with ps command and then, use the following command:

kill -9 <thread_id>

So, what’s the result? Dude … this thread is invincible!. True, by default, kernel thread ignores all the signals. The reason behind this is same as explained above. Kernel thread has a full control over when can it be killed. So, the only way to get out of this problem is to kill the problem, that means, reboot the system. This program has a bug, so read on to fix this bug.

So, now the question is, how to let the kernel thread know that, somebody is willing to stop it. For this, there is a call called kthread_should_stop(). This function returns non-zero value, if there is any outstanding ‘stop’ request. Thread should invoke this call periodically and if it returns true, it should do the required clean up and exit. Below is the code snippet using this mechanism:

static struct task_struct *thread_st;
// Function executed by kernel thread
static int thread_fn(void *unused)
{
    while (!kthread_should_stop())
    {
        printk(KERN_INFO "Thread Running\n");
        ssleep(5);
    }
    printk(KERN_INFO "Thread Stopping\n");
    do_exit(0);
    return 0;
}

Here, the thread periodically invokes kthread_should_stop() and exits, if this function returns a non-zero value. In exit_module() function, we call kthread_stop() function to notify the thread, as earlier.

Signalling the Kernel Thread

As we have already seen, by default, kernel thread ignores all the signals. So, how do we send the signal to the kernel thread, if at all it’s required in some scenarios? Again, we have some set of calls to support this. First call is allow_signal(). Below is the prototype for the same:

void allow_signal(int sig_num)

Parameters:
sig_num – signal number

Unlike user space, there are no asynchronous signal handlers in kernel threads. So, thread should periodically invoke signal_pending() call to check if there is any pending signal and should act accordingly. Below is the prototype for the same:

int signal_pending(task_struct *p)

Parameters:
p – pointer to the task structure of the current thread

Returns:  Non-zero value, if signal is pending

Below is the code snippet for handling the signals:

static struct task_struct *thread_st;
// Function executed by kernel thread
static int thread_fn(void *unused)
{
    // Allow the SIGKILL signal
    allow_signal(SIGKILL);
    while (!kthread_should_stop())
    {
        printk(KERN_INFO "Thread Running\n");
        ssleep(5);
        // Check if the signal is pending
        if (signal_pending(thread_st))
            break;
    }
    printk(KERN_INFO "Thread Stopping\n");
    do_exit(0);
    return 0;
}

Compile the code and insert the module with insmod. Now, find the thread id using ps and execute the below command:

kill -9 <thread_id>

With this, you will see that thread exits, once it detects the SIGKILL signal. Now, just try removing the module with rmmod. What do you get? rmmod comes out gracefully without blocking.

Conclusion

So, with this, I am done with kernel threads. Aah! I missed out one thing from the last article. Why was that crash in the code from the last article? As you might have observed, when I call kthread_stop() in the exit module, the thread terminates after kthread_should_stop() returns true, and we don’t see a crash. So, does it mean that kthread_stop() prevents crash? In a way yes, but we need to understand the fundamental reason behind the crash. As you know, like any other process, thread also requires a memory to execute. So, where does this memory come from? No points for guessing the right answer, its from the module memory. So, when you unload the module, that memory is freed up and its no longer valid.  So, our poor chap tries to access that and its destined to crash.

So, that’s about the kernel threads. In the next article, we will touch upon the concurrency management in the kernel. So, stay tuned …

Next Article >>

Pradeep D Tewani (12 Posts)

The author used to work at Intel, Bangalore. The author is a Linux enthusiast and is interested in Linux porting, Linux Kernel Internal & Linux device drivers. He shares his learnings on Linux & embedded systems through his workshops & trainings. Learn more about his experiments at http://sysplay.in.


   Send article as PDF   

13 thoughts on “Kernel Threads Continued

  1. Pingback: Kernel Threads | Playing with Systems

  2. Pingback: Concurrency Management in Linux Kernel | Playing with Systems

  3. Arpit

    in your example if i try following ( ssleep part comment out) , then also rmmod is stuck forever, could you please explain why ?

    while (!kthread_should_stop())
    {
    printk(KERN_INFO “Thread Running\n”);
    //ssleep(5);
    }

    Reply
    1. Anil Kumar Pugalia

      ssleep() has nothing to do with it. It would be based on the call kthread_should_stop(). Check out your code, once again.

      Reply
  4. ami

    Hello,

    Thanks for the nice explaination about kthread.
    Although, i get kernel panic after i do rmmod when the thread function is already killed by kill -9

    do you know why this happens?
    I am on 4.4.0-34-generic @ ubuntu 16.-4

    #include
    #include
    #include
    #include
    #include
    #include //for ssleep()
    #include //for allow_signal()

    MODULE_LICENSE(“GPL”);
    MODULE_AUTHOR(“Amitesh Singh”);
    MODULE_DESCRIPTION(“example for kthread creation”);
    MODULE_VERSION(“0.1”);

    static struct task_struct *task;
    static int ret;

    static int
    thread_function(void *data)
    {
    allow_signal(SIGKILL);

    while (!kthread_should_stop())
    {
    printk(KERN_INFO “thread is running and doing the job required”);
    if (signal_pending(task))
    break;
    ssleep(5);
    }
    printk(KERN_INFO “Stopping the thread function.. exiting..”);

    return 0;
    }

    static int __init
    kernel_init(void)
    {
    printk(KERN_INFO “create kthread example”);

    task = kthread_create(&thread_function, NULL, “_ami_”);
    if (task) wake_up_process(task);

    printk(KERN_INFO”Kernel Thread name : %s\n”, task->comm);

    return 0;
    }

    static void __exit
    kernel_exit(void)
    {
    //stop the kthead on unloading the module
    ret = kthread_stop(task);
    printk(KERN_ALERT “Unloading the module: %d”, ret);
    }

    module_init(kernel_init);
    module_exit(kernel_exit);

    Reply
    1. Vaibhav

      i am also running into the same problem, Pradeep any idea why we see a crash while removing the module when the thread is already killed by a signal

      Reply
  5. Vaibhav

    static struct task_struct *thread_st;
    // Function executed by kernel thread
    static int thread_fn(void *unused)
    {
    // Allow the SIGKILL signal
    allow_signal(SIGKILL);
    while (!kthread_should_stop())
    {
    printk(KERN_INFO “Thread Running\n”);
    ssleep(5);
    // Check if the signal is pending
    if (signal_pending(thread_st))
    break;
    }
    printk(KERN_INFO “Thread Stopping\n”);
    do_exit(0);
    return 0;
    }

    static int __init skm_init(void)
    {
    printk(“Hello World\n”);
    printk(KERN_INFO “Creating Thread\n”);
    //Create the kernel thread with name ‘mythread’
    thread_st = kthread_run(thread_fn, NULL, “mythread”);
    if (thread_st)
    printk(KERN_INFO “Thread Created successfully\n”);
    else
    printk(KERN_ERR “Thread creation failed\n”);
    return 0;
    }

    static int __exit skm_exit(void)
    {
    printk(KERN_INFO “Cleaning Up\n”);
    if (thread_st)
    {
    kthread_stop(thread_st);
    printk(KERN_INFO “Thread stopped”);
    }
    printk(“Goodbye World\n”);
    }

    Hi Pradeep
    In above code if i do below sequence of steps i see a crash. Any idea.
    1. insmod
    2. kill the thread using kill command for mythread
    3. Remove the mod and i see a crash
    However if i do an insmod and do a rmmod then i dont see the crash

    Reply

Leave a Reply to Devarsh Cancel reply

Your email address will not be published. Required fields are marked *